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ABSTRACT 


The  branch-and-bound  technique  has  been  the  basis  for  algorithms 
to  solve  both  the  mixed  integer  linear  program  (having  linear  objec¬ 
tive  function,  linear  constraints,  and  integrality  restrictions  on 
some  variables)  and  the  concave  nonlinear  program  (having  a  separable 
concave  objective  function  and  linear  constraints).  The  subprograms 
for  each  of  these  branch-and-bound  algorithms  are  linear  programs 
with  simple  upper  bounds. 

In  Volume  1,  a  new  branch-and-bound  algorithm  is  presented  for 
the  composite  mixed  integer,  concave  nonlinear  program.  This  integer 
concave  (IC$N)  algorithm  has  been  implemented  in  the  form  of  a  com¬ 
puter  program  coded  in  FORTRAN.  A  guide  to  the  use  of  the  computer 
program,  together  with  examples  of  its  application,  is  included  in 
Volume  1.  Documentation  of  the  computer  program  is  included  in 
Volume  2. 
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FOREWORD 


Optimization  problems  involving  integer-valued  decision  variables 
occur  frequently  in  operations  research  and  in  systems  analysis.  Many 
cost-effectiveness  analyses  performed  within  the  Department  of  Defense 
are  optimization  problems  of  this  type.  Specific  applications  related 
to  amphibious  operations  occur  in  mine  warfare,  logistics,  and  fire 
support.  This  report  presents  a  new  method  for  solving  a  large  class 
of  integer  nonlinear  optimization  problems. 

The  material  presented  here  implements  ideas  developed  during  the 
author's  program  of  studies  in  the  Department  of  Operations  Research, 
School  of  Engineering  and  Applied  Science,  The  George  Washington 
University,  Washington,  D.  C.  Support  for  this  research  in  integer 
nonlinear  optimization  and  the  development  of  computational  algorithms 
has  been  provided  by  the  Naval  Surface  Weapons  Center's  Independent 
Research  Program.  The  author  is  presently  involved  in  surface  warfare 
applications  of  this  optimization  technique. 
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SOLUTION  OF  THE 
INTEGER  CONCAVE  PROGRAM 
USING  THE  IC0N  ALGORITHM 

VOLUME  1 


: 


1.  INTRODUCTION 


Hie  branch-and-bound  method  is  a  theoretical  tool  which  has  been 
used  to  solve  various  types  of  optimization  problems  and,  in  particular 
to  solve  mathematical  programs.  An  abstract  optimization  problem 
involves  (i)  a  set  of  variables,  (ii)  a  constraint  set  which  consists 
of  feasible  combinations  of  the  variables,  and  (iii)  an  objective 
function  (a  mathematical  expression)  which  is  to  be  optimized  over 
the  constraint  set.  In  the  case  of  a  mathematical  program,  the  set 
of  variables  is  customarily  finite  and  the  constraint  set  is  defined 
implicitly  by  a  system  of  equations  or  other  mathematical  relationships 

The  terminology  "mathematical  program"  derives  from  the  appli¬ 
cation  of  mathematics  to  the  solution  of  economic  problems  involving 
the  allocation  ("programming")  of  scarce  resources  subject  to 
constraints.  The  first  such  problems  to  be  formulated  were  linear 
programs,  having  a  linear  objective  function  (to  be  minimized  or 
maximized)  and  linear  equations  (either  equalities  or  inequalities) 
defining  the  constraint  set.  The  simplex  algorithm  of  Danzig  (1963) 
provides  the  solution  method  usually  used  for  linear  programs. 

Mathematical  programming  now  finds  application  in  varied  and 
diverse  areas,  with  a  significant  number  of  these  applications  re¬ 
sulting  in  nonlinear  programs.  A  nonlinear  program  can  occur  if  the 
objective  function  or  a  constraint  equation  is  nonlinear.  An 
important  example  of  a  nonlinear  constraint  is  the  requirement  that 
some  variables  must  be  integer-valued .  Branch-and-bound  algorithms 
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have  been  developed  to  solve  the  mixed  integer  linear  program  (having 
linear  objective  function,  linear  constraints  and  integrality 
restrictions)  and  the  concave  nonlinear  program  (having  separable 
concave  objective  function  and  linear  constraints).  Each  of  these 
nonlinear  programs  extends  the  concept  of  a  linear  program. 

The  integer  concave  program  is  a  composite  of  the  mixed  integer 
linear  program  and  the  concave  nonlinear  program.  Application  of  the 
branch-and-bound  method  to  the  solution  of  this  program  was  dis¬ 
cussed  in  Loomis  (1973b).  This  report  presents  a  branch-and-bound 
algorithm  for  the  integer  concave  program  (the  IC0N  algorithm)  and 
provides  a  guide  to  the  use  of  a  computer  program  which  implements  the 
algorithm. 

Chapter  1  includes  a  statement  of  the  integer  concave  program 
and  other  related  mathematical  programs.  Chapter  2  describes  the 
basic  branch-and-bound  method  used  to  solve  the  integer  concave 
program.  A  description  of  the  options  available  in  the  IC0N  algorithm 
is  given  in  Chapters  3,  4  and  5.  Test  programs  which  illustrate  the 
application  of  the  IC0N  algorithm  are  presented  in  Chapter  6.  The 
preparation  of  input  for  the  computer  program  is  described  in 
Appendices  A,  B  and  C  using  the  test  programs  as  examples. 

1 . 1  The  Integer  Concave  Program 

Two  forms  of  the  integer  concave  program  are  considered  in  this 
section.  The  first  of  these  is  the  mathematical  program 
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u. 


.  ..  4. 


(*) 


minimize  f(x)  =  Z  f.(x.) 

j=l  J  J 

such  that  Ax  =  b 

0  s  x  £  u° 

Xj  integer  for  jej. 


A  is  an  mxn  matrix  (m  £  n)  and  b  is  a  vector  in  Em  with  b  £  0. 
The  vector  u°  in  En  represents  an  upper  limit  on  x,  where  u°  £  0  but 
u°  need  not  be  finite.  The  index  set  J  is  an  arbitrary  subset  of 
N  =  Cl,  2 ,  ...  ,  n}. 

The  objective  function 

f(x)  =  Z  fi(xi) 
j=l  2  2 


is  assumed  to  be  a  separable  concave  function  on  the  hypercube 

[0,  u°] ;  that  is,  f  is  the  sum  of  functions  fj  of  a  single  variable 

with  each  function  fj  being  a  concave  function  on  the  interval 

[0,  Uj],  A  concave  function  of  a  single  variable  is  defined  by  the 

property  that  linear  interpolation  always  underestimates  the  function 

value. ^  Further  properties  of  concave  functions  can  be  found  in 

Fiacco  and  McCormick  (1968,  Section  6.1).  Selected  examples  of 


A  function  c(v)  of  a  single  variable  v  is  concave  on  the  interval  I  if 
c(wv^  +  (1  -  w)v£)  a  w  c(v^)  +  (1  -  w)  c(v2> 
for  all  choices  of  v^,  v^  e  I  and  0  £  w  £  1. 
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functions  fj  are  shown  in  Figure  1. 

In  the  statement  of  program  (*) ,  the  equation  Ax  =  b  is  synonymous 
with  the  system  of  m  linear  equality  constraints 


ailXl  +  ai2X2  + 


+  a.  x  =  b.  (1 
in  n  1 


i  s-  m) . 


Constraints  which  involve  inequalities  or  :•)  are  readily  transformed 
into  equalities  by  the  addition  of  slack  or  surplus  variables  to  the 
program.  For  example, 

ailxl  +  ai2x2  +  •••  +  ainxn  bi 


becomes 


3ilXl  +  ai2X2  + 


+  a.  x  +  1  x  . 
in  n  n+1 


=  b. 


with  the  addition  of  the  slack  variable  xn+^  0  to  the  program.  (In 
the  other  constraints  and  in  the  objective  function,  xn+^  is  added  but 
with  a  coefficient  of  0.) 

A  finite  lower  limit  1°  on  x  can  also  be  included  in  the  program 
formulation.  Under  the  transformation  y  =  x  -  & ° ,  the  constraints 

Ax  =  b 
1°  <.  x  s  u° 


become 
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(linear) 


(linear  with  setup 
cost  at  origin) 


f . 
J 


(piecewise  linear)  (concave  with  discontinuities 

at  endpoints  of  interval) 


FIGURE  1 


EXAMPLES  OF  CONCAVE  FUNCTIONS 
OF  A  SINGLE  VARIABLE 


Ay  =  b  -  Af° 


_  o 

0  ^  y  u 


„o 

l 


which  has  the  form  of  program  (*).  The  conditions  b  0  and  u°  0 
in  program  (*)  are  replaced  by  conditions  b  -  AJl°  ^  0  and  u°  £  1° 


when  the  lower  limit  constraint  is  added  to  the  program.  Also,  each 
component  function  fj  is  now  required  to  be  concave  on  the  interval 


The  computer  program  which  implements  the  IC0N  algorithm  performs 
the  two  transformations  just  mentioned,  and  thus  solves  the  following 
(more  general)  form  of  the  integer  concave  program: 


(1CP) 


minimize 


such  that 


n 

f(x)  =  2  f i (x ;  ) 

j=l  J  J 


Xj  integer  for  jej. 


In  the  balance  of  this  report,  the  notation  Ax  =  b  will  be  used  in 
place  of 


to  simplify  notation. 

Various  additional  transformations  and  techniques  are  frequently 
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useful  for  reducing  problems  encountered  in  practice  to  the  form  of 
program  (ICP).  Some  of  these  may  be  found  in  Wagner  (1969,  Chapter  3) 
and  in  Garfinkel  and  Nemhauser  (1972,  Section  1.4), 


1.2  Other  Mathematical  Programs 


The  integer  concave  program  includes  as  special  cases  several 


other  mathematical  programs  which  occur  commonly  in  applications. 
These  may  also  be  solved  using  the  IC0N  algorithm. 

The  mixed  integer  linear  program 


(MILP) 


minimize 

such  that 


f(x)  =  I  c-x, 
j  =  l  3  3 


Ax  =  b 


1°  <,  x  S  u° 


Xj  integer  for  jej. 


is  a  special  case  of  the  integer  concave  program  which  has  a  linear 
objective  function. 

A  branch-and-bound  algorithm  for  solving  the  mixed  integer  linear 
program  was  first  developed  by  Land  and  Doig  (1960).  Subsequent 
modifications  and  refinements  are  reflected  in  the  algorithms  of 
Dakin  (1965);  Davis,  Kendrick  and  Weitzman  (1971);  and  Tomlin  (1971). 

Deleting  the  integrality  requirements  from  the  integer  concave 
program  results  in  the  concave  nonlinear  program 
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minimize 


(CP) 


such  that 


n 

f(x)  =  Z  f.(x  ) 
j=l  J  J 


Ax  =  b 

.o  o 

a  <  x  s  u  . 


A  branch-and-bound  algorithm  for  solving  this  program  and  other  more 
general  separable  nonconvex  programs  was  developed  by  Falk  and 
Soland  (1969). 

A  final  special  case  of  the  integer  concave  program  is  the 
linear  program 


The  solution  of  linear  programs  having  bounded  variables  utilizes  a 
modification  of  Dantzig's  simplex  algorithm  which  is  discussed  in 
Lasdon  (1970,  Section  6.3)  and  in  Garfinkel  and  Nemhauser  (1972, 
Section  2.8). 
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2.  THE  BRANCH- AND- BOUND  METHOD 


The  branch-and-bound  method  for  the  integer  concave  program  is 
based  on  the  transformation  of  a  single  program  into  a  sequence  of 
subprograms.  An  essential  part  of  the  method  is  a  dynamic  scheme 
which  monitors  the  selection  of  the  subprograms  to  be  examined.  As¬ 
sociated  with  each  stage  of  the  branch-and-bound  method  are  lower  and 
upper  bounds  on  the  optimal  objective  function  value  which  serve  as 
the  natural  basis  for  a  convergence  criterion. 

Section  2.1  presents  the  basic  branch-and-bound  method  (method  1) 
for  the  integer  concave  program.  Method  1  includes  as  options  the 
selection  of  particular  computational  procedures  and  rules  which, 
when  they  are  specified,  convert  an  abstract  method  into  a  workable 
algorithm.  A  bounding  procedure  which  can  be  applied  to  the  indi¬ 
vidual  subprograms  is  presented  in  Section  2.2.  The  bounding  of  a 
subprogram  is  based  upon  the  solution  of  a  related  linear  program. 
Section  2.3  describes  a  constraint  set  partitioning  procedure.  Con¬ 
vergence  properties  of  the  branch-and-bound  method  are  presented  in 
Section  2.4„  The  final  section  gives  an  interpretation  of  the  method 
from  the  standpoint  of  graph  theory. 

2. 1  Method  1 

Corresponding  to  the  statement  of  program  (ICP)  given  in  Section 
1.1,  let 
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Q  =  (x  |  Ax  =  b] 


H°  =  {x  !  1°  <:  x  -  u°} 

X  =  [x  !  x.  Integer  for  jej}. 

Q  is  a  linear  polyhedron  and  H°  is  a  hypercube  in  En.  In  terras  of  this 
notation,  an  equivalent  formulation  for  the  integer  concave  program  is 

(M)  minimize  f(x) 

xeM 

where  M  =  Q  H°  fl  X.  This  is  called  the  master  program  for  the  branch- 
and-bound  method.  M  is  the  set  of  feasible  solutions  to  the  master 
program.  When  the  optimal  objective  function  value  for  the  master 
program  is  finite,  it  will  be  denoted  by  f*.  In  addition,  if  this 
value  is  attained  at  some  point  in  M,  then  the  set  of  optimal  solutions 

M*  =  {xeM  |  f(x)  =  f*} 

is  nonempty.  The  branch-and-bound  method  seeks  to  determine  the  optimal 
solution  value  f*  and  an  optimal  solution  x*  e  H*  whenever  these  exist. 
Additionally,  in  the  event  that  M*  is  empty  or  f*  does  not  exist,  the 
method  discovers  this  fact  and  terminates  computations  accordingly. 

The  branch-and-bound  method  proceeds  in  a  series  of  stages 
t  =  1,  2,  ...  .  Each  stage  involves  the  examination  of  one  or  two 
subprograms .  A  typical  subprogram  i  (i  =  1,  2,  ...  )  is  an  integer  con¬ 
cave  program  of  the  form 


.1. 
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minimize 

xeM^ 


f(x) 


(M1) 


where  =  Q  fl  fl  X  and  =  {x  |  l}~  £  x  r  u*-}  is  a  subset  of  H°. 

The  examination  of  subprogram  i  consists  of  applying  a  bounding  pro¬ 
cedure  which  yields  a  lower  bound  LB(i)  on  the  optimal  objective  func¬ 
tion  value  for  subprogram  i  and  an  upper  bound  UB(i)  on  the  optimal 
objective  function  value  to  the  master  program.  Two  alternative 
bounding  procedures  are  presented  in  Sections  2.2  and  3.1. 

Stage  t  =  1  consists  of  only  one  subprogram  (subprogram  1)  which 
serves  to  initiate  the  branch-and-bound  method.  Subprogram  1  has  the 
same  constraint  set  as  the  master  program,  =  Q  fl  fl  X  where 
f{l  =  h°  (i.e.,  =  £°  and  u^  =  u°) .  The  bounding  procedure  is  applied 

to  obtain  lower  bound  LB(1)  on  subprogram  1  and  upper  bound  UB(1)  on 
the  master  program.  The  best  upper  bound  at  stage  1  is  defined  by 

BUB(l)  =  UB ( 1)  . 

Let  N ( 1)  =  £  1}  and 

BLB(l)  =  min  LB(i)  =  LB(1). 
ieN(l) 

N(l)  is  the  set  of  active  subprograms  at  stage  1  and  the  quantity 
BLB(l)  is  the  best  lower  bound  at  stage  1. 

For  t  r-  2,  stage  t  of  the  branch-and-bound  method  will  now  be 
described.  Assume  that  the  following  data  (resulting  from  stage  t — 1 ) 
are  given: 
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(i)  N(t-l),  a  nonempty  subset  of  {l,  2,  ...  ,  2t  -  3}; 

(it)  H1  =  [x  |  f  x  s  u1]  and  LB(i)  for  i  e  N(t-l);  and 
(ill)  BUB(t-l). 

A  branching  subprogram  k  e  N(t-l)  is  selected  using  one  of  the 
rules  presented  in  Section  4.1.  Subprograms  s  and  s+1  (where 
s  =  2t  -  2)  are  considered  at  this  stage.  The  constraint  set  for 
subprogram  k  is  partitioned  to  form  the  constraint  sets  for  sub¬ 
programs  s  and  s+1.  This  is  accomplished  by  splitting  the  hypercube 
into  hypercubes  Hs  and  Hs+^.  Constraint  set  partitioning  is  dis¬ 
cussed  further  in  Section  2.3. 

Subprograms  s  and  s+1  have  constraint  sets  Ms  =  Q  fl  Hs  fl  X  and 

q  1  I  q  1  1 

M  =  Q  D  H  D  X.  The  bounding  procedure  is  applied  to  obtain 
lower  bound  LB(s)  on  subprogram  s  and  upper  bound  UB(s)  on  the  master 
program.  LB(s+l)  and  UB(s+l)  are  determined  similarly. 

The  best  upper  bound  at  stage  t  is  the  quantity 

BUB(t)  =  min  {BUB(t-l),  UB(s) ,  UB(s+l)}. 

The  set  of  active  subprograms  N(t)  at  stage  t  is  now  formed.  First, 
define 


I(t)  =  N(t-l)  \  {k}  U  {8,8+1} 

and  then 


N(t)  =  U  e  I(t)  |  LB(i)  <  BUB(t)}. 
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If  N(t)  is  an  empty  set,  then  the  branch-and-bound  method  terminates. 
Otherwise,  the  best  lower  bound  at  stage  t  is  defined  to  be  the  quantity 

BLB(t)  =  min  LB(i) 
ieN(t) 

and  the  branch-and-bound  method  proceeds  to  the  next  stage. 

2.2  Bounding 

In  the  branch-and-bound  method  presented  in  Section  2.1,  a  bound¬ 
ing  procedure  is  applied  to  each  subprogram  i  (i  =  1,  2,  ...  ).  The 
bounding  procedure  determines  a  lower  bound  LB(i)  on  the  optimal  ob¬ 
jective  function  value  for  subprogram  i  and  an  upper  bound  UB(i)  on 
the  optimal  objective  function  value  for  the  master  program.  This 
section  presents  the  first  of  two  alternative  bounding  procedures. 

The  typical  subprogram  is  an  integer  concave  program  of  the  form 

i  n 

(M  )  minimize  f(x)  =  2-  f.(x.) 

xeM*  j=l  J  J 

where  M*  =  Q  11  H*  •  X.  The  bounding  procedure  begins  with  the  formula¬ 
tion  of  an  auxiliary  linear  program 

i  n 

(R  )  minimize  g^x)  =  ^  g*(x  ) 

xeR1  j=l  J  -J 
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For  a  mixed  integer  linear  program,  the  bounding  procedure  just 
described  agrees  with  the  procedure  used  by  Dakin  (1965)  and  others. 
Subprogram  i  and  the  linear  program  (K*-)  coincide  in  this  case.  For 
a  concave  nonlinear  program,  this  bounding  procedure  agrees  with  that 
of  Falk  and  Soland  (1969).  The  condition  x^  e  always  holds  for  this 
case  and  each  feasible  subprogram  yields  a  finite  upper  bound. 

2 . 3  Const raint  Set  Partitioning 

Essential  to  the  generation  of  subprograms  is  the  constraint  set 
partitioning  procedure.  Upon  the  selection  of  a  branching  subprogram 
k,  this  procedure  is  applied  to  select  constraint  sets  for  subprograms 
s  and  s+1.  To  apply  the  constraint  set  partitioning  procedure,  the 
hypercube  11^  =  {x  J  *  x  <.  u^j  and  the  solution  x^  to  linear  program 

Jr 

(R  )  are  required. 

The  partition  begins  with  the  selection  of  a  brandling  variable 

x.  (1  <  j  <  n)  using  one  of  the  rules  presented  in  Sections  4.2  or 
*o 

4.3.  If  the  branching  variable  is  an  integer  variable  (ioe-0,  let 

L  =  fx  |  X  V  [X1;  ]} 
o  o 

U  =  fx  I  x.  -  <xk  >1  .3 

-1  „  J 

o  Jo 


3[v]  denotes  the  largest  integer  less  than  or  equal  to  v,  while  ( v ) 
denotes  the  smallest  integer  greater  than  or  equal  to  v. 
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If  the  branching  variable  is  not  an  integer  variable  (j  ^J),  let 

L  =  fx  I  x .  <  xk  ] 


U  =  fx  I  x.  &  x.  1  . 


L  and  U  are  the  lower  and  upper  cut s  corresponding  to  value  x.  of  the 

-'o 


branching  variable. 


C  n  j  1 

Hypercubes  11  and  H  are  formed  by  setting 


Hs  =  Hk  fl  L 
Hs+1  =  Hk  n  U. 


The  lower  and  upper  limits  appearing  in  IIs  =  (x  |  Is  S  x  s  us}  and 
Hs+^  =  [x  I  s  x  t:  us+^}  thus  agree  with  those  of  Hk  with  the 

exception  of  the  limits  on  the  branching  variable. 

This  procedure  for  constraint  set  partitioning  was  introduced 
by  Dakin  (1965)  for  mixed  integer  linear  programs  and  was  adopted  by 
Falk  and  Soland  (1969)  for  concave  nonlinear  programs. 

2.4  Convergence 

Assume  that  the  set  M*  of  optimal  solutions  to  the  integer  con¬ 
cave  program  is  nonempty.  In  this  case, 

LB(1)  s  min  f(x)  =  min  f(x)  =  f* 
xeM1  xeM 


since  subprogram  1  coincides  with  the  master  program.  As  a  consequence 
of  the  definitions  BLB(l)  =  LB(1)  and  BUB(l)  =  UB(1), 


BLB(l)  £  f*  <  BUB(l) 


The  convergence  properties  of  the  branch-and-bound  method  are 
based  on  the  fact  that,  at  any  stage  t, 

BLB(t)  r  f*  £  BUB(t) . 

Because  the  sequence  of  best  lower  bounds  is  nondecreasing  and  the 
sequence  of  best  upper  bounds  is  nonincreasing,  the  precision  with 
which  f*  is  determined  improves  as  the  method  progresses  from  stage 
to  stage.  These  facts  about  the  branch-and-bound  method  are  summarized 
in  the  following  theorem. 

Theorem  1.  If  t  ^  2,  N(t-l)  and  N(t)  are  nonempty,  then 
BLB(t-l)  s;  BLB(t)  <  f*  £  BUB(t)  £  BUB(t-l). 

The  convergence  of  the  method  depends,  first,  on  the  ability  of 
the  method  to  establish  a  finite  best  upper  bound  and,  second,  to 
narrow  the  gap  between  the  best  lower  bound  and  the  best  upper  bound. 
The  branch-and-bound  method  can  therefore  be  regarded  as  having  two 
phases.  Phase  1  seeks  to  determine  a  feasible  solution  for  the  master 
program,  thus  establishing  a  finite  best  upper  bound.  Phase  2  seeks 
to  verify  the  optimality  of  this  feasible  solution.  In  the  course  of 
this  verification,  the  optimality  of  the  feasible  solution  could  be 
denied  through  the  determination  of  another  feasible  solution  which 
yields  an  improved  best  upper  bound.  The  second  phase  thus  seeks  to 
verify  the  optimality  of  the  current  best  feasible  solution. 
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The  branch-and-bound  method  is  said  to  be  finitely  convergent 
if,  for  any  integer  concave  program,  the  method  terminates  in  a  finite 
number  of  stages.  The  following  theorem  describes  the  conditions 
which  occur  at  termination. 

Theorem  2.  If  t  >  2,  N(t-l)  is  nonempty  and  N(t)  is 
empty,  then  BLB(t-l)  <  BUB(t-l)  and  BUB(t)  =  f*.  In 
this  case,  if  i  is  an  index  for  which  UB(i)  =  BUB(t) 
and  x*-  is  the  corresponding  feasible  solution  determined 
by  applying  the  bounding  procedure  to  subprogram  i, 
then  x1  is  an  optimal  solution. 

At  termination  of  the  method,  an  optimal  solution  and  the  optimal 
solution  value  have  both  been  computed.  Finite  convergence  is  not 
guaranteed  in  general.  However,  if  the  method  employs  a  branching 
subprogram  selection  rule  from  Section  4.1  and  a  branching  variable 
selection  rule  from  Sections  4.2  or  4.3,  then  the  following  result 
holds . 

Theorem  3.  If  H°  =  {x  I  1°  £  x  <  u°]  is  a  compact  set, 
then  the  branch-and-bound  method  for  the  integer  concave 
program  converges  finitely. 

Finite  convergence  for  the  concave  nonlinear  program  is  proved  in 
Falk  and  Soland  (1969).  Their  result  is  required  for  the  proof  of 
Theorem  3. 

The  results  thus  far  have  been  made  under  the  assumption  that 
the  set  M*  of  optimal  solutions  is  nonempty.  For  the  case  that  M*  is 


empty,  the  branch-and-bound  method  depends  exclusively  on  lower  bound 
for  its  convergence  properties.  Under  the  hypotheses  of  Theorem  3^ 
finite  termination  also  occurs  for  this  case. 


2.3  The  Bran ch-and- Bound  Tree 

The  branch-and-bound  method  has  a  structure  which  admits  of  an 
interpretation  from  the  standpoint  of  graph  theory.  For  this  reason, 
graph  theoretic  terminology  occurs  ofte'.  in  the  lexicon  of  branch-and 
bound.  The  terminology  used  here  is  natural  and  self-explanatory. 
Definitions  and  other  related  aspects  of  graph  theory  may  be  found 
in  Berge  (1962). 

Imbedded  within  the  branch-and-bound  method  is  a  graph  called 
the  branch-and-bound  tree.  The  indices  i  =  1,  2,  ...  associated 
with  the  subprograms  are  regarded  as  the  nodes  of  this  graph. 

Stage  t  =  1  of  the  method  begins  with  subprogram  1  which  corresponds 
to  the  root  node  (node  1)  of  the  branch-and-bound  tree.  At  sub¬ 
sequent  stages  t  >  2  of  the  method,  a  branching  subprogram  k 
is  selected  and  two  new  subprograms  are  created,  subprograms  s  and 
s  +  1  (where  s  =  2t  -  2).  In  the  branch-and-bound  tree,  this 
corresponds  to  the  creation  of  nodes  s  and  s  +  1  which  are  connected 
to  node  k  by  arcs .  These  arcs  are  denoted  by  (k,s)  and  (k,s+l), 
respectively. 


LB(i^)  <  LB(i2)  ^  ... 

for  either  of  the  lower  bounding  procedures  described  in  Sections  2.2 
and  3.1. 

A  hypothetical  example  of  a  branch-and-bound  tree  is  shown  in 

Figure  3.  Indicated  in  the  figure  are  the  upper  and  lower  bounds 

UB(i)/LB(i)  associated  with  each  subprogram  i.  Table  1  gives  the 

best  upper  bound  BUB(t),  the  best  lower  bound  BLB(t),  and  the  set 

N(t)  of  active  subprograms,  for  each  stage  t.  In  this  example, 

phase  1  of  the  computation  consists  of  stages  1,  2  and  3.  Phase  2 

begins  at  stage  4  with  the  discovery  of  a  feasible  solution  to  the 

6  6 

master  program  at  subprogram  6  (x  e  M°).  With  the  termination  of  the 
computation  at  stage  6,  this  feasible  solution  is  found  to  be  optimal. 
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FIGURE  3 


THE  BRANCH-AND- BOUND  TREE 


TABLE  1 


The  evolution  of  the  branch-and-bound  tree  is  described 


through  a  series  of  subgraphs  G(t)  for  each  stage  t  =  1,  2 . 

The  subgraph  G(t)  consists  of  nodes  1,  2,  ...  ,  2t  -  1.  The  set 
N(t)  of  active  subprograms  at  stage  t  corresponds  to  a  subset  of 
the  pendant  nodes  in  this  subgraph.  Based  on  the  preceeding  example 
of  a  branch-and-bound  tree,  Figure  4  shows  the  subgraphs  G(l),  ...  , 
G(5)  associated  with  the  first  five  stages  and  the  corresponding 
sets  N(l),  ...  ,  N(5)  of  active  subprograms.  Note  that  G(6)  is 
the  same  as  the  entire  tree  shown  in  Figure  3  and  that  N(6)  is  empty. 


3.  PENALTY  TECHNIQUES 


An  alternate  bounding  procedure  for  the  integer  concave  program 
uses  a  system  of  "penalties"  from  which  stronger  lower  bounds  for 
individual  subprograms  may  be  computed.  Penalty  techniques  have  been 
applied  in  branch-and-bound  algorithms  for  the  mixed  integer  linear 
program,  but  their  application  to  the  integer  concave  program  is  new. 

Application  of  the  constraint  set  partitioning  procedure  together 
with  linear  programming  sensitivity  analysis  to  derive  penalties  and 
stronger  lower  bounds  is  described  in  Section  3.1.  Constraint  set 
tightening,  a  second  application  of  penalty  techniques,  is  described 
in  Section  3.2. 

3 . 1  Bounding 

The  second  bounding  procedure  for  a  typical  subprogram  i  begins 
with  the  solution  of  auxiliary  linear  program  (R1)  as  in  Section  2.2. 
The  optimal  solution  value  to  the  linear  program  is  then  tested  for 
its  sensitivity  to  small  deviations  of  individual  variables  Xj  from 
the  values  x^.  This  results  in  the  derivation  of  a  lower  bound  for 
subprogram  i  which  is  stronger  than  that  produced  by  the  first  bounding 
procedure. 

Selecting  a  variable  Xj  (Is  j  <  n),  the  affect  of  adjoining  the 
constraint  xj  =  v  to  the  linear  program  is  considered.  From  sensi¬ 
tivity  analysis  techniques  of  linear  programming,  the  optimal  solution 
value  for  linear  program  (R*-)  with  this  constraint  adjoined  (regarded 


as  a  function  of  the  parameter  v)  is  convex  and  piecewise  linear.  An 
example  of  this  function  is  denoted  by  G1(v)  in  Figure  5.  The  left 
and  right  derivatives  of  G*(v)  at  v  =  x^  are  denoted  by  mQ(j)  and 
m^(j),  and  are  obtainable  from  the  final  tableau  for  linear  program 
(Rl).  These  derivatives  provide  a  means  for  constructing  a  simple 
function,  consisting  of  the  two  dashed  linear  segments  shown  in 
Figure  5,  which  underestimates  G1(v)  over  all  values  v. 

Consider  now  the  hypothetical  case  that,  at  some  future  stage  of 
the  branch-and-bound  method,  subprogram  i  is  selected  as  the  branching 
subprogram  and  variable  Xj  is  selected  as  the  branching  variable. 
Figures  6  and  7  apply  to  the  cases  of  Xj  an  integer  or  noninteger 
variable  (respectively).  The  quasi-linear  underestimate  for  fj  is 
modified  as  indicated  for  the  linear  programs  (Rs)  and  (Rs+1) .  The 
optimal  solution  value  functions  Gs(v)  and  Gs+^(v)  are  related  to 
G^Cv)  by 

GS(v)  =  G1 (v)  +  g®(v)  -  g^(v) 

GS+1(v)  =  G1(v)  +  g®+1(v)  -  gj(v). 


Corresponding  relationships  hold  between  simple  linear  underestimates 
for  Gs(v)  and  Gs+^(v)  (having  slopes  m^C j )  and  m^(j))  and  the  under¬ 
estimate  for  G1(v). 


A  lower  bound  for  subprogram  s  is  the  minimum  value  p^(j)  along 
the  linear  segment  having  slope  m^(j).  This  is  simply  the  minimum  of 
the  two  endpoints  of  the  line  segrw  at.  A  lower  bound  p^(j)  for 
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subprogram  s+1  is  defined  similarly.  In  comparison  to  the  lower  bound 


produced  by  the  first  bounding  procedure,  the  quantities  p  (j)  and 

0 

p^(j)  reflect  the  penalties  which  would  occur  if  variable  xj  were 
selected  as  the  branching  variable.  Since  the  constraint  sets  for 
subprograms  s  and  s+1  contain  the  set  for  subprogram  i,  the  quantity 

min  { pQ ( j ) ,  P1(j)} 

is  a  lower  bound  for  subprogram  i. 

Considering  all  possible  choices  of  j  (1  £  j  r  n) ,  the  penalty 
analysis  leads  to  the  definition 

LB(i)  =  max  min  {p0(j),  px ( j) } . 
l^j<n 

The  upper  bound  UB(i)  for  this  bounding  procedure  is  defined  as  in 
Section  2.2. 

The  bounding  procedure  for  the  integer  concave  program  presented 
in  this  section  agrees  with  the  procedure  used  by  Davis,  Kendrick  and 
Weitzman  (1971)  for  the  mixed  integer  linear  program.  Application  of 
penalty  techniques  to  the  integer  concave  program  was  first  indicated 
in  Loomis  (1973b). 

3.2  Limit  Tightening 

The  algorithm  for  the  concave  nonlinear  program  developed  by  Falk 
and  Soland  uses  the  slopes  mg(j)  and  m^(j)  to  tighten  the  lower  and 
upper  limits  Cj  and  Uj  on  each  variable  xj .  In  the  algorithm  for  the 
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integer  concave  program  presented  here,  the  slopes  m^Q)  and  m^(j) 
can  be  used  for  the  same  purpose. 

Examples  of  limit  tightening  for  the  integer  concave  program  are 
shown  in  Figure  8  (for  an  integer  variable)  and  in  Figure  9  (for  a 
noninteger  variable).  The  procedure  involves  the  computation  of  the 
intercept  of  the  line  having  slope  HqQ)  (or  m^(j))  with  the  horizontal 
line  corresponding  to  the  current  best  upper  bound  BUB(t).  In  the 
example  of  Figure  8,  the  upper  bound  u^  is  replaced  by  (ui)7.  Such 
limit  tightening  is  justified  by  the  fact  that  no  point  y  of  the  set 
M*-  fl  (x  |  Xj  £  (uj)7}  can  provide  an  improvement  on  the  current  best 
upper  bound  since 

f*  £  BUB(t)  <  gi(y)  £  f(y). 

It  should  be  noted  that  limit  tightening  can  be  effective  only 
during  phase  2  of  the  branch-and-bound  method  when  BUB(t)  is  finite. 
Limit  tightening  is  most  naturally  employed  at  the  same  time  as  the 
bounding  procedure  described  in  Section  3.1. 
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4.  BRANCHING  SUBPROGRAM  AND  BRANCHING  VARIABLE  SELECTION 


A  branching  subprogram  selection  rule  is  required  in  the  branch- 
and-bound  method  of  Section  2.1.  This  rule  serves  to  determine  the 
order  in  which  the  active  subprograms  are  processed.  Section  4.1 
presents  the  characteristics  of  two  branching  subprogram  selection 
rules,  the  LIFO  and  priority  rules,  which  may  be  used  in  the  solution 
of  integer  concave  programs. 

Constraint  set  partitioning,  discussed  in  Sections  2.1  and  2.3, 
serves  to  dichotomize  the  constraint  set  for  a  branching  subprogram, 
generating  constraint  sets  for  two  new  subprograms  while  excluding 
from  further  consideration  points  which  are  irrelevant  with  respect 
to  the  master  program  solution.  The  partitioning  procedure  utilized 
here  requires  a  branching  variable  selection  rule.  Section  4.2 
presents  the  maxmin  and  maxmax  rules,  both  of  which  are  based  upon 
the  penalty  techniques  of  Chapter  3.  Other  branching  variable 
selection  rules  are  discussed  in  Section  4.3  which  may  be  used  in 
the  solution  of  mixed  integer  linear  programs  or  concave  nonlinear 
programs . 

4. 1  LIFO  and  Priority  Rules 

Two  alternative  rules  which  may  be  applied  to  select  a  branching 
subprogram  from  among  the  active  subprograms  are  the  LIFO  (last  in/ 
first  out)  and  priority  rules.  Application  of  the  LIFO  rule  results 
in  the  selection  of  the  subprogram  which  was  the  last  one  added  to 
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the  set  of  active  subprograms.  The  priority  rule  results  in  the 
selection  of  an  active  subprogram  for  which  the  corresponding  lower 
bound  is  the  least.  A  family  of  branching  subprogram  selection  rules 
which  span  the  gap  between  the  LIFO  and  priority  rules  is  discussed 
in  Section  5.4. 

Figure  10  gives  a  typical  example  of  the  branch-and-bound  tree 
structure  which  results  from  the  LIFO  rule.  Each  node  in  this  tree 
corresponds  to  a  subprogram  in  the  branch-and-bound  method.  Indicated 
in  the  figure  are  the  upper  and  lower  bounds  UB(i)/LB(i)  associated 
with  the  i-th  subprogram.  Table  2  gives  the  corresponding  statistical 
data:  the  best  upper  bound  BUB(t),  the  best  lower  bound  BLB(t),  and 

the  set  N(t)  of  active  subprograms  for  each  stage  t.  Figure  11  shows 
the  same  example  solved  using  the  priority  rule,  with  Table  3  giving 
the  corresponding  statistical  data.  In  this  example,  the  branch-and- 
bound  computation  resulting  from  the  LIFO  rule  examines  some  subprograms 
which  have  no  counterpart  in  the  computation  resulting  from  the 
priority  rule.  Otherwise,  the  two  computations  differ  only  in  the 
sequence  in  which  the  subprograms  are  examined. 

The  subprograms  which  are  examined  initially  using  the  LIFO  rule 
correspond  to  the  nodes  on  a  single  path  of  the  branch-and-bound  tree 
called  the  principal  path.  This  path  terminates  when  a  branching 
subprogram  gives  rise  to  a  pair  of  subprograms  having  lower  bounds 
greater  than  or  equal  to  the  current  best  upper  bound.  The  LIFO  rule 
then  selects  the  active  subprogram  for  which  the  corresponding  node  is 
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TREE  STRUCTURE  FOR  THE  LIFO  RULE 


TABLE  2 


STATISTICS  FOR  THE  TREE  WITH  THE  LIFO  RULE 
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FIGURE  11 


TREE  STRUCTURE  FOR  THE  t^IORITY  RULE 


TABLE  3 
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nearest  to  the  tip  of  the  principal  path.  The  offshoot  which  emanates 
from  this  node  is  then  pursued  until  no  further  active  subprograms 
are  generated  and  the  path  terminates.  The  LIFO  rule  then  selects 
another  offshoot  from  the  principal  path  and  the  process  is  repeated. 

The  priority  rule  is  more  flexible  in  its  approach  to  the  selection 
of  the  branching  subprogram  than  is  the  LIFO  rule.  Under  the  priority 
rule,  the  node  corresponding  to  the  branching  subprogram  (the  active 
subprogram  with  least  lower  bound)  at  one  stage  need  not  be  on  the 
same  path  as  the  node  corresponding  to  the  branching  node  at  the 
preceding  stage.  The  priority  rule  thus  leads  to  the  simultaneous 
exploration  of  all  paths  within  the  branch-and-bound  tree.  The  path 
containing  the  node  for  which  the  corresponding  subprogram  yields  an 
optimal  solution  may  be  the  only  path  which  is  examined  completely. 

The  LIFO  rule  was  first  used  in  a  branch-and-bound  algorithm 
for  the  mixed  integer  linear  program  by  Dakin  (1965).  The  priority 
rule  was  used  both  in  the  algorithm  of  Davis,  Kendrick  and  Weitzman 
(1971)  for  the  mixed  integer  linear  program  and  in  the  algorithm  of 
Falk  and  Soland  (1969)  for  the  concave  nonlinear  program. 

4 . 2  Maxmin  and  Maxmax  Rules 

Upon  the  selection  of  a  branching  subprogram  k,  a  constraint 
set  partitioning  procedure  is  applied  to  determine  constraint  sets 
for  subprograms  s  and  s  +  1.  This  procedure  begins  with  the  selection 
of  a  branching  variable  x.  (1  ^  j  <  n)  as  described  in  Section  2.3. 


Two  alternative  rules  which  may  be  applied  to  select  the  branching 
variable  are  the  maxmin  and  maxmax  rules.  These  rules  employ  the 
penalty  techniques  of  Chapter  3  to  make  an  optimal  selection. 
Consequently,  the  maxmin  or  maxmax  branching  variable  selection  rules 
may  be  used  quite  efficiently  in  conjunction  with  the  bounding 
procedure  of  Section  3.1. 

In  the  notation  of  Section  3.1,  the  maxmin  rule  results  in  the 

selection  of  a  variable  x.  for  which 

Jo 

max  min  f PQ ( j ) >  PL ( j ) } 
l<j<n 

i  attained.  This  expression  is  the  same  as  the  lower  bound  LB (k)  for 
br  iching  subprogram  k.  The  maxmax  rule  results  in  the  selection  of 
a  variable  x.  for  which 


max  max  ^ Pq  ( j  )  ,  Pj^Cj)} 
l<j  <n 

is  attained.  This  second  expression,  which  is  larger  than  LB(k), 
involves  the  same  basic  quantities  as  those  used  in  the  computation 
of  LB(k)  but  in  a  different  logical  combination.  Consequently, 
branching  variable  selection  using  either  the  maxmin  or  maxmax  rules 
may  be  done  with  little  additional  effort  at  the  time  that  the  lower 
bounding  procedure  is  applied. 
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is  at  a  maximum  tor  j  j  ,  tho  maxmin  rulo  guarantees  tho  largest 
possible  Increase  lor  both  l.ll(s)  ami  I.H(sH').  On  tho  other  liaml,  bv 
selecting  the  branching  variable  x  such  that 


o 


max  fp()(  i),  pt(  ))] 


is  at  a  maximum  tor  j  j  ,  the  maxmax  rule  guarantees  the  largest 
possible  increase  in  one  ot  IJi(s')  or  l.ll(sll)  but  guarantees  nothing 
with  respect  to  the  other  lower  houml. 

the  lol  lowing  moilitiotl  maxmax  rule  is  a  compromise  which  attempts 
to  avoiil  the  inability  ol  the  maxmax  rule  to  guarantee  an  increase  in 


both  blits')  ami  1.11  ( s  ll).  The  moilitieil  maxmax  rule  results  in  the 


selection  of  a  variable  x.  for  which 


max  max  rPQ(j),  P^j)) 
jeZ 


is  attained,  where 

Z  =  [jeN  j  min  fPg(j),  P^j)"1  >  gk(xk)1  . 

The  maxmin  branching  variable  selection  rule  was  first  used  in  a 
branch-and -bound  algorithm  for  the  mixed  integer  liner  program  by 
Davis,  Kendrick  and  Weitzman  (1971).  The  maxmax  rule  was  first  used 
for  the  mixed  integer  linear  program  by  Dakin  (1975).  With  the 
development  of  penalty  techniques  described  in  Chapter  3,  the  maxmin 
and  maxmax  rules  may  now  be  applied  to  solve  the  integer  concave  program. 

4 . 3  Other  Branching  Variable  Selection  Rules 

Additional  branching  variable  selection  rules  may  be  employed 
to  solve  the  special  cases  of  the  integer  concave  program  described 
in  Section  1.2.  For  the  mixed  integer  linear  program,  alternative 
rules  are  the  most  noninteger  rule  and  the  weighted  noninteger  rule. 

For  the  concave  nonlinear  program,  an  alternative  rule  is  the 
conventional  rule  of  Falk  and  Soland  (1969).  These  rules  do  not 
require  the  penalty  techniques  of  Chapter  3.  Consequently,  these 
rules  may  be  used  in  conjunction  with  the  bounding  procedure  of  either 
Section  2.2  or  Section  3.1. 
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In  the  case  of  the  mixed  integer  linear  program,  let 
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leJ 
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x  .  is 
J 


noninteger"! 


k  • 

where  x  is  the  solution  to  the  auxiliary  linear  program  for  branching 

subprogram  k.  The  most  noninteger  rule  results  in  the  selection  of  a 

variable  x.  for  which 


*  r  k  r  /  k .  k, 
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is  attained.  The  weighted  noninteger  rule  results  in  the  selection  of 
a  variable  x.  for  which 


max  Ic.l  min  fx*^  -  r  x^l  (x*?)  -  x^l 
u  '  J  1  J  j  J  J ; 

jeZ* 

is  attained.  The  weighted  noninteger  rule  is  an  attempt  to  reflect 
the  sensitivity  of  the  objective  function  to  changes  in  the  variable 
values.  The  most  noninteger  and  weighted  noninteger  rules  provide  a 
direct  approach  to  branching  variable  selection,  involving  a  small 
number  of  computational  steps,  as  opposed  to  the  detailed  analysis 
which  forms  the  basis  for  the  maxmin  and  maxmax  rules. 

In  the  case  of  the  concave  nonlinear  program,  let 
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where  x  is  the  solution  to  the  auxiliary  linear  program  for  branching 

subprogram  k.  The  conventional  rule  of  Falk  and  Soland  (1969)  results 
in  the  selection  of  a  variable  x.  for  which 


,  ,  k.  k.  k. 
max  f  (x  )  -  g  (x  ) 


is  attained.  This  rule  provides  a  direct  approach  to  branching 
variable  selection,  involving  a  small  number  of  computational  steps. 


as  opposed  to  the  detailed  analysis  which  forms  the  basis  for  the 


maxmin  and  maxmax  rules  for  the  concave  nonlinear  program. 


5.  SOLUTION  STRATEGIES 


A  branch-nnd -bound  method,  such  as  method  I  described  in  Section 
2.1,  includes  optional  computational  procedures  and  rules.  These  are: 
the  bounding  procedure,  the  branching  subprogram  selection  rule,  and  the 
constraint  set  partitioning  rule.  In  turn,  the  constraint  set 
partitioning  rule  is  equivalent  to  a  branching  variable  selection  rule 
and  an  option  to  perform  limit  tightening.  A  particular  choice  of 
these  procedures  and  rules  is  called  a  solution  strategy.  A  branch- 
and-bound  method  together  with  a  solution  strategy  thus  results  in  a 
branch-and -bound  algorithm  which  can  be  applied  to  solve  an  integer 
concave  program. 

The  various  possible  solution  strategies  result  in  algorithms 
having  widely  different  convergence  properties.  Consequently,  a 
solution  strategy  is  usually  chosen  so  as  to  optimize  some  measure  of 
effectiveness  associated  with  the  branch-and-bound  computation. 

Examples  of  this  are:  to  minimize  the  number  of  stages  required  to 
complete  the  branch-and-bound  computation;  to  minimize  the  number  of 
stages  required  to  determine  an  initial  feasible  solution;  or  to 
minimize  the  maximum  number  of  active  nodes  over  all  stages. 

Solution  strategies  consisting  of  various  branching  subprogram 
selection  and  branching  variable  selection  rules  for  the  mixed 
integer  linear  program  have  been  evaluated  by  Mitra  (1973).  For  the 
integer  concave  program  considered  here,  the  evaluation  of  the 
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effectiveness  of  solution  strategies  is  extended  to  include  the  limit 
tightening  option  and  the  availability  of  an  initial  best  upper  bound. 

The  basic  solution  strategies  for  the  integer  concave  program  are 
discussed  in  Section  5.1  with  consideration  being  given  to  the 
qualitative  impact  of  the  strategy  on  the  convergence  of  the 
algorithm.  Important  examples  of  basic  solution  strategies  are  the 
LIFO/maxmax  and  priority/maxmin  strategies.  Section  5.2  discusses 
the  formation  of  a  composite  solution  strategy  from  two  different 
basic  strategies  which  are  appropriate  to  the  two  different  phases  of 
the  branch-and-bound  method.  The  primary  example  of  such  a  composite 
strategy  is  to  use  the  LIFO/maxmax  strategy  during  phase  1  and  the 
priority/maxmin  strategy  during  phase  2. 

A  new  branch-and-bound  method,  the  variable  best  upper  bound  method, 
has  been  developed  for  the  solution  of  integer  concave  programs.  This 
method  serves  to  improve  the  performance  of  phase  1  computations  when 
a  composite  solution  strategy  is  employed.  Its  effectiveness  is 
derived  from  the  efficiencies  which  accrue  when  an  initial  estimate  is 
available  for  the  optimal  objective  function  value  f  ,  as  discussed  in 
Section  5.3.  The  variable  best  upper  bound  method  includes  a  means  for 
generating  and  refining  such  an  estimate  during  phase  1  of  the 
branch-and-bound  method.  This  is  the  subject  of  Sections  5.4  and  5.5. 

5 . 1  Basic  Solution  Strategies 

Figure  12  shows  the  basic  solution  strategies  for  the  integer 
concave  program  as  well  as  solution  strategies  which  apply  only  to  the 


Mixed  Integer  Linear 


BASIC  SOLUTION  STRATEGIES 


particular  cases  of  the  mixed  integer  linear  program  and  the  concave 
nonlinear  program.  The  bounding  procedures  shown  include  the  normal 
lower  bounding  procedure  described  in  Section  2.2,  and  the  lower 
bounding  procedure  based  upon  the  penalty  techniques  described  in 
Section  3.1.  The  branching  subprogram  selection  rules  shown  in 
Figure  12  include  the  LIFO  and  priority  rules  of  Section  4.1.  The 
branching  variable  selection  rules  include:  the  maxmin,  maxmax,  and 
modified  maxmax  rules  of  Section  4.2  (which  apply  to  the  integer 
concave  program) ;  the  most  noninteger  and  weighted  noninteger  rules  of 
Section  4.3  (which  apply  only  to  the  mixed  integer  linear  program); 
and  the  conventional  rule  of  Falk  and  Soland  described  in  Section  4.3 
(which  applies  only  to  the  concave  nonlinear  program).  Limit 
tightening,  as  described  in  Section  3.2,  may  be  employed  as  an  option. 

Two  combinations  of  branching  subprogram  selection/branching 
variable  selection  rules  which  are  commonly  employed  in  solution 
strategies  are  the  priority /maxmin  rules  and  the  LIFO/maxmax  rules. 

As  stated  in  Section  4.2,  the  maxmin  or  maxmax  rules  may  be  used 
quite  efficiently  in  conjunction  with  the  system  of  stronger  lower 
bounds  based  upon  penalty  techniques.  This  combination  is  adopted  in 
the  solution  strategies  shown  in  Figure  12.  The  priority/maxmin 
solution  strategy  (with  limit  tightening)  was  used  for  the  mixed 
integer  linear  program  by  Davis,  Kendrick  and  Weitzman  (1971).  The 
LIFO/maxmax  solution  strategy  (but  with  the  normal  bounding  procedure) 
was  used  for  the  mixed  integer  linear  program  by  Dakin  (1965). 


Consider  first  the  priority/maxmin  solution  strategy.  As  the 
branching  subprogram  k,  the  priority  rule  selects  an  active  subprogram 
for  which  the  corresponding  lower  bound  is  the  least.  This  leads  to 
the  increase  of  the  best  lower  bound  as  rapidly  as  possible.  The 
maxmin  branching  variable  selection  rule,  on  the  other  hand,  generates 
new  subprograms  s  and  s+1  such  that  the  corresponding  lower  bounds 
increase  as  much  as  possible  in  comparison  with  the  lower  bound  for 
subprogram  k.  The  priority  and  maxmin  rules  are  thus  complementary 
and  result  in  a  solution  strategy  which  emphasizes  the  convergence  of 
the  best  lower  bound. 

An  example  of  the  branch-and-bound  tree  structure  which  results 

from  the  LIFO/maxmax  solution  strategy  is  given  in  Figure  13.  The 

corresponding  statistical  data  is  shown  in  Table  4.  As  the  branching 

subprogram  k,  the  LIFO  rule  selects  the  subprogram  which  was  the  last 

to  be  added  to  the  set  of  active  subprograms.  The  maxmax  branching 

variable  selection  rule  generates  new  subprograms  s  and  s+1  such  that 

one  of  the  corresponding  lower  bounds,  say  LB(s),  increases  as  much  as 

possible  but  guarantees  nothing  with  respect  to  the  amount  of  increase 

for  the  other  lower  bound,  LB(s+l).  Under  the  LIFO  rule,  subprogram 

4 

s+1  would  be  the  branching  subprogram  at  the  next  stage.  That  is,  the 
4 

If  Pq(J0)  <  P^(jc)»  it  is  LB(s+l)  which  is  guaranteed  to  increase  as 

much  as  possible.  In  this  case,  subprogram  s  is  selected  as  the 
branching  subprogram  at  the  next  stage.  This  is  accomplished  by 
listing  subprograms  s  and  s+1  in  the  set  of  active  subprograms  in 
reverse  order . 
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TABLE  4 

STATISTICS  FOR  THE  TREE  WITH 
THE  LIFO/MAXMAX  SOLUTION  STRATEGY 
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subprogram  which  has  the  larger  lower  bound  remains  in  the  set  of 
active  subprograms  while  the  subprogram  which  has  the  smaller  lower 
bound  becomes  the  branching  subprogram  at  the  next  stage.  Considering 
the  subprograms  which  correspond  to  nodes  on  the  principal  path  of  the 
tree,  the  sequence  of  lower  bounds  increases  slowly.  In  the  event 
that  the  bounding  procedure  yields  a  feasible  solution  along  the 
principal  path,  this  feasible  solution  may  be  optimal  or  near 
optimal,  and  the  initial  finite  best  upper  bound  resulting  from  this 
feasible  solution  would  be  small.  As  the  active  subprograms  generated 
along  the  principal  path  correspond  to  larger  lower  bounds,  many  active 
subprograms  could  be  eliminated  with  the  determination  of  this  best 
upper  bound.  The  LIFO  and  maxmax  rules  are  thus  complimentary  and 
result  in  a  solution  strategy  which  emphasizes  the  convergence  of  the 
best  upper  bound. 

5.2  Strategies  for  Different  Phases 

The  separation  of  the  branch-and-bound  method  into  two  phases  was 
discussed  in  Section  2.4.  Phase  1  of  the  method  seeks  to  determine  an 
initial  feasible  solution,  thereby  establishing  a  finite  best  upper 
bound.  Phase  2  seeks  to  verify  the  optimality  of  the  current  best 
feasible  solution,  an  objective  which  is  attained  when  the  set  of  active 
subprograms  becomes  empty.  Individual  solution  strategies  differ  with 
respect  to  their  efficiency  in  accomplishing  these  phase  1/phase  2 
objectives.  For  example,  the  LIFO/maxmax  solution  strategy  is  best  suited 
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to  the  phase  1  objective  bat  is  inefficient  with  respect  to  the 
number  of  stages  required  to  attain  the  phase  2  objective.  The 
prioritv/maxmin  solution  strategy,  on  the  other  hand,  is  better 
suited  to  phase  2  than  to  phase  1. 

A  composite  solution  strategy  results  when  different  solution 
strategies  are  employed  for  the  different  phases  of  the  branch-and- 
bound  method.  An  example  of  such  a  composite  is  the  use  of  the 
LIFO/maxmax  solution  strategy  during  phase  1  and  the  priority/ 
maxmin  solution  strategy  during  phase  2.  This  example  is  discussed 
further  below  as  an  illustration  of  the  techniques  required  to 
implement  a  composite  strategy. 

Assume  that  the  branch-and -bound  method  begins  computations  with 

the  LIFO/maxmax  solution  strategy  and  the  lower  bounding  procedure  which 

uses  the  stronger  lower  bound  associated  with  the  penalty  techniques 

of  Section  3.1.  For  each  subprogram  k  during  phase  1,  apply  the  maxmax 

branching  variable  selection  rule  to  determine  a  branching  variable  and 

k  k 

the  associated  cuts  L^,  U^.  Simultaneously,  apply  the  maxmin 

branching  variable  selection  rule  to  determine  a  branching  variable 

k  k 

and  the  associated  cuts  L2,  Ug*  If  an  active  subprogram  k  is  selected 
as  the  branching  subprogram  during  phase  1,  define 


Hs  =  Hk  n 
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When  phase  1  ends,  the  LIFO/maxmax  solution  strategy  is  replaced  by 

the  priority /maxmin  solution  strategy.  The  Lower  bounding  procedure 

is  unchanged  with  this  replacement.  During  phase  2,  the  maxmin 

branching  variable  selection  rule  and  the  determination  of  cuts 
k  k 

L? ,  l'?  is  continued  but  the  application  of  the  maxmax  rule  is  no 
longer  required.  If  an  active  subprogram  k  is  selected  as  the 
branching  subprogram  during  phase  2,  define 

HS  =  Hk  n  L* 

s+1  k  k 
H  =  H  n  \j 

The  LIFO/maxmax  and  pr ior ity/maxmin  solution  strategies  are  thus  used 
in  the  particular  phase  for  which  each  is  best  suited.  The  resulting 
composite  solution  strategy  has  convergence  properties  superior  to 
those  of  either  the  LIFO/maxmax  or  prior ity/maxmin  strategies 
individually.  These  properties  are  attained  at  the  expense  of  having 
to  make  branching  variable  selections  according  to  two  rules  during 
phase  1.  For  the  example  considered  here,  however,  the  additional 
computation  required  to  perform  two  selections  is  negligible  because 
of  the  similarities  between  the  maxmax  and  maxmin  rule. 

The  limit  tightening  option  should  be  mentioned  in  connection 
with  composite  solution  strategies.  The  procedures  presented  in 


Section  3.2  for  limit  tightening  depend  upon  the  presence  of 
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a  finite  best  upper  bound  for  their  implementation.  As  ft  consequence , 
limit  I  ightculng  Is  onlv  done  during  plt.aso  .’  ot  t  ho  h  ranch -and -hound 
mot  hod . 

S.  I  luit  ial  Host  Upper  lUnmd 

In  tho  fippllo.'it  Itnt  ot  nnv  solut  Ion  strategy,  thoro  are  instances 
whore  the  lull  in!  feasible  solut ion  Is  far  from  opt imal.  This  can 
occur  even  tor  tht'  1.1  fO/maxmax  solut  ion  strategy.  In  such  ft  case, 
the  corresponding  Initial  finite  best  upper  bound  mav  then  be  so 
laic,*'  that  relatively  few  active  subprograms  are  eliminated  through 
the  comparison  ot  lower  bounds  with  the  best  upper  bound.  This  effect 
contributes  to  the  occurrence  of  lengthy  branch-and -bound 
comput at  i ons . 

The  effect  can  be  alleviated  when  an  init  ial  estimate  is 

A 

nvn  1 1  aMo  I'or  tho  opt  imal  ohjoot  ivo  funct  (on  vaim*  f  .  II  lUJH(O)  is 
t he  given  estimate,  mod  1 1 v  tho  branch-and -bound  method  bv  sett  ing 

IU1U(  1 1  -  min  f  IIUII(O)  ,  Ull(  1  )  i 

at  stage  l.  figure  14  presents  the  same  example  as  was  considered  in 
figure  1  1  (an  appl  (cat  ion  of  the  1,1  fO/maxmax  solut  (on  strategy),  but 
with  an  Initial  estimate  1U1H(0)  “  h.  Table  b  presents  the 
corresponding  statistical  data.  With  this  initial  best  upper  bound, 
the  method  terminates  a  node  when  the  correspond ing  lower  bound  exceeds 
111111(0).  The  isovalue  contour  which  corresponds  tc  the  lower  bound 
value  S  (l.o.  ,  1,11  *  S)  is  shown  in  figure  14.  The  subgraph  consist  ing 


TABLE  5 


STATISTICS  FOR  THE  TREE  WITH 
A  GIVEN  INITIAL  BEST  UPPER  BOUND 


t 

BU  B  ( t ) 

BLB(t) 

N(t) 

1 

5 

I 

[1] 

2 

5 

1 

(3} 

3 

5 

1 

{5] 

4 

5 

1 

[6,  7} 

5 

5 

2 

U,  9} 

6 

5 

2 

[6,  11} 

7 

5 

2 

(6} 

8 

5 

2 

[14,  15} 

9 

5 

3 

[14} 

10 

5 

3 

(19} 

11 

5 

4 

{21} 

12 

4 

-  - 

l  } 
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of  the  nodes  examined  under  this  method  is  bounded  by  the  contour 
LB  =  5  in  the  sense  that  each  node  of  the  subgraph  is  the  terminal 
node  of  an  arc  emanating  from  within  this  contour.  The  availability 
of  a  good  initial  upper  bound  thus  leads  to  the  examination  of  fewer 
nodes.  In  particular,  when  the  LIFO/maxmax  solution  strategy  is 
employed,  this  provides  a  natural  mechanism  for  limiting  the  tree 
search  and  assuring  that  the  initial  feasible  solution  will  be  near 
optimal . 

In  the  case  of  an  initial  estimate  BUB(O)  being  used  which  is 

* 

less  than  f  ,  no  feasible  solution  to  the  master  program  will  be 
found.  Termination  of  the  branch-and -bound  computation  with  no 
feasible  solution  being  found  should  be  interpreted  as  implying  that 
f  >  BUB(O).  In  this  case,  computations  should  be  repeated  with  a 
larger  value  of  BUB(O). 

The  use  of  an  upper  limit  on  the  optimal  objective  function 
value  f  to  facilitate  branch-and -bound  computations  was  advocated  by 
Land  and  Doig  (1960)  for  the  case  of  a  mixed  integer  linear  program. 

5.4  Variable  Best  Upper  Bounds 

As  noted  in  Section  5.3,  an  initial  feasible  solution  which  is 
far  from  optimal  can  occur  no  matter  which  solution  strategy  is  used. 
For  the  case  of  a  composite  solution  strategy,  this  occurrence  has 
the  effect  of  transferring  the  major  burden  of  the  branch-and-bound 
computation  to  phase  2.  In  the  particular  case  of  a  composite 
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solution  strategy  which  uses  the  LIFO/maxmax  strategy  during  phase  1 
and  the  prior itv/maxmin  strategy  during  phase  2,  the  pr ior ity/maxmin 
strategy  must  then  serve  to  determine  better  feasible  solutions  in 
addition  to  the  usual  phase  2  objective  of  verifying  the 
optimality  of  the  current  best  feasible  solution.  The  determination 
of  feasible  solutions  is,  of  course,  the  task  for  which  the  priority/ 
maxmin  strategy  is  least  suited.  On  the  other  hand,  phase  2 
computations  are  facilitated  when  the  intial  feasible  solution 
determined  during  phase  1  is  near  optimal.  A  new  method  is  described 
in  this  section  which  can  achieve  this  result. 

The  variable  best  upper  bound  method  is  intended  for  use  during 
phase  1.  This  method  serves  to  limit  the  tree  search  for  the  case 
where  no  initial  estimate  of  f  is  available.  The  basis  for  the 
method  is  the  treatment  of  the  best  upper  bound  as  a  free  parameter. 
After  selecting  an  initial  value  for  the  best  upper  bound,  the  subgraph 
bounded  by  the  corresponding  isovalue  contour  is  explored.  If  a 
feasible  solution  is  encountered,  the  method  enters  phase  2;  otherwise, 
a  larger  value  for  the  best  upper  bound  is  selected  and  the  subgraph 
bounded  by  the  corresponding  contour  is  explored.  This  process  is 
repeated  until  an  initial  feasible  solution  is  encountered. 

The  efficient  exploration  of  the  successive  subgraphs  requires 
that  two  sets  of  active  subprograms  be  maintained.  At  stage  t,  N(t) 
is  the  set  of  subprograms  which  would  be  considered  to  be  active  if 
the  best  upper  bound  were  +  N'(t)  is  the  subset  of  N(t)  consisting 
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of  those  subprograms  which  are  active  in  the  subgraph  being  examined. 
In  the  event  that  N '(t)  becomes  empty  at  stage  t,  a  new  best  upper 
bound  is  established  by  setting 

BUB(t)  =  BLB(t)  +  A 

N'(t)  =  fieN(t)  |  LB(i)  ^BUB(t)} 

where  the  increment  A  is  assumed  to  be  an  input  to  the  method.  N'(t) 
thus  contains  those  subprograms  of  N(t)  which  lie  in  the  band 
between  two  consecutive  contours. 

Figure  15  presents  an  example  of  the  structure  of  the  branch- 
and-bound  tree  which  results  from  the  variable  best  upper  bound 
method  having  A  =  2.  Table  6  gives  the  corresponding  statistical 
data.  In  this  particular  case,  the  initial  feasible  solution  is  in 
fact  optimal. 

5. 5  Method  2 

The  variable  best  upper  bound  method  (method  2)  is  stated  here 
using  the  terminology  and  notation  established  in  Section  2.1  for  the 
basic  branch-and-bound  method  (method  1). 

Stage  t  =  1  consists  of  only  one  subprogram  (subprogram  1) 
which  serves  to  initiate  phase  1  of  the  branch-and-bound  method. 
Subprogram  1  has  the  same  constraint  set  as  the  master  program, 

=  Q  fl  PI  X  where  =  H°.  The  bounding  procedure  of  the  phase  1 
solution  strategy  is  applied  to  obtain  lower  bound  LB(1)  on 
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TABLE  6 

STATISTICS  FOR  THE  TREE  WITH 
THE  VARIABLE  BEST  UPPER  BOUND  METHOD 


t 

BUB(t) 

BLB(t) 

N(t) 

N  ( t) 

1 

3 

1 

U] 

[1} 

2 

3 

1 

1 2, 

3} 

13} 

3 

3 

1 

12, 

4, 

5} 

{5} 

4 

3 

1 

[2, 

4, 

6, 

7} 

(6,  7} 

5 

3 

2 

[2, 

4, 

6, 

8, 

9} 

[6} 

6 

3 

2 

(2, 

4, 

8, 

9, 

10, 

11} 

[11} 

7 

5 

3 

[2, 

4, 

8, 

9, 

10, 

12, 

13} 

[9,  10} 

8 

5 

3 

{2, 

4, 

8, 

10, 

12, 

13, 

14, 

15} 

[10,  15} 

9 

5 

3 

(2, 

4, 

8, 

10, 

12, 

13, 

14, 

17} 

[10} 

10 

5 

3 

(2, 

4, 

8, 

12, 

13, 

14, 

17, 

18, 

19} 

[19} 

11 

5 

4 

(2, 

4, 

8, 

12, 

13, 

14, 

17, 

18, 

20,  21} 

[21} 

12 

4 

_ 

1 

} 

[  } 

subprogram  1  and  upper  bound  UB(1)  on  the  master  program.  If 
UB(1)  *  ®  occurs,  the  branch-and-bound  method  enters  phase  2  and  the 
balance  of  the  computation  (for  stage  t=l  and  subsequent  stages)  is 
the  same  as  in  method  1  but  employing  the  phase  2  solution  strategy. 

So  assume  that  the  case  UB(1)  =  00  occurs.  Let  N(l)  =  N'(l)  =  [I] 
and 

BLB(l)  =  min  LB(i)  =  LB(1) 
ieN(l) 

BUB(l)  =  BLB(l)  +  A. 

For  t  s  2,  stage  t  of  the  branch-and-bound  method  will  now  be 
described.  Assume  that  the  following  data  (resulting  from  stage  t-1) 
are  given: 

(i)  N(t-l)  and  N'(t-l),  nonempty  subsets  of 

(1,  2 . 2t  -  3}  with  N'(t)  C  N(t); 

(ii)  H*  =  {x  |  «  x  s  ui}  and  LB(i)  for  i  e  N(t-l);  and 

(iii)  BUB(t-l) . 

A  branching  subprogram  k  e  N'lt-l)  is  selected  using  the 
branching  subprogram  selection  rule  of  the  phase  1  solution  strategy. 
Subprograms  s  and  s+1  (where  s  =  2t  -  2)  are  considered  at  this  stage. 
The  constraint  set  for  subprogram  k  is  partioned  to  form  the 

constraint  sets  for  subprograms  s  and  s+1,  accomplished  by  splitting 

k  s  s+1 

hypercube  H  into  hypercubes  H  and  H 
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s  s 

Subprograms  s  and  s+1  have  constraint  sets  M  =  Q  fl  H  OX  and 
s+1  s+1 

M  =  Q  ("I  H  H  X.  The  bounding  procedure  is  applied  to  obtain 
lower  bound  LB(s)  on  subprogram  s  and  upper  bound  UB(s)  on  the  master 
program.  LB(s+l)  and  UB(s+l)  are  determined  similarly.  If  either 
UB(s)  <  co  or  UB(s+l)  <  ®  occurs,  the  branch-and -bound  method  enters 
phase  2  and  the  balance  of  the  computation  (for  stage  t>2  and  subsequent 
stages)  is  the  same  as  in  method  1  but  employing  the  phase  2  solution 
strategy.  So  assume  that  the  case  UB(s)  =  UB(s+l)  =  »  occurs. 

Form  the  index  sets 


I(t)  =  N(t-l)  \  {k}  U  {s,  s+1} 

N(t)  =  [i  e  I(t)  |  LB(i)  <  oo} 

N'(t)  =  [i  e  N(t)  |  LB(i)  <  BUB(t-l) }. 

The  best  lower  bound  at  stage  t  is 

BLB(t)  =  min  LB(i) . 
ieN(t) 

If  N'(t)  is  not  empty,  the  best  upper  bound  at  stage  t  is 

BUB(t)  =  BUB(t-l) .  If  N'(t)  is  empty, 

BUB(t)  =  BLB(t)  +  A 


and  redefine 


N'(t)  =  {i  e  N(t)  |  LB(i)  <  BUB(t) } . 

The  branch-and -bound  method  then  proceeds  to  the  next  stage. 
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6 .  TEST  PROGRAMS 


This  chapter  presents  sample  integer  concave  programs  of  the  types 
which  may  be  solved  using  the  branch-and-bound  method.  The  complete 
forme.  1  at  ion  and  solut  ion  of  these  programs  is  presented  so  that  they 
may  be  used  to  test  the  operation  of  the  IC0N  algorithm.  The 
preparation  of  input  for  the  1C0N  algorithm  is  described  in 
Appendices  A,  B,  and  C  using  the  test  programs  as  examples. 

Computational  experience  with  the  IC$N  algorithm  is  summarized 
briefly  for  each  type  of  program- -concave  nonlinear,  mixed  integer 
linear,  and  integer  concave. 


6 . 1  A  Concave  Nonlinear  Program 

Test  program  1  is  a  concave  nonlinear  program  obtained  from 
Falk  and  Soland  (1971).  The  formulation  and  solution  of  this  test 
program  are  shown  in  Tables  7  and  8.  Application  of  the  branch-and- 
bound  method  to  test  program  1,  using  the  priority/maxmin  solution 
strategy  and  limit  tightening,  results  in  the  statistics  shown  in 
Table  9.  For  any  concave  nonlinear  program,  phase  2  begins  with  the 
first  subprogram.  Three  subprograms  are  examined  for  test  program  1, 
with  the  solution  being  obtained  at  subprogram  3.  The  maximum  size  of 
the  set  of  active  nodes  (the  "branch-and-bound  list")  is  1. 


Computational  experience  with  concave  nonlinear  programs  has 


included  the  solution  of  programs  from  Falk  and  Soland  (1971)  and 


TABLE  7 


TEST  PROGRAM  1 

minimize  -130x^  +  “  160xj  +  f^(x^) 


such  that  10x^ 

+ 

IOX2 

+  ' 

iOx^ 

-r 

10x4 

150 

7X1 

+ 

5x0 

+ 

3x3 

+ 

2x4 

100 

3x, 

+ 

5x. 

+ 

IOx, 

+ 

15x, 

< 

100 

0  <  x^  <  100 
0  s  X2  <  25 

0  s  X3  s  100 

0  £  x^  £  25 


where 


,  if  X2  =  0 


f2(x2)  = 


2000  -  130x2  -  10x2  ,  if  x2  >  0 


,  if  x4  =  0 


W 


2000  -  2OOX4  -  I8X4  ,  if  X4  >  0 
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TABLE  9 


BRANCH -AND- BOUND  STATISTICS  FOR  TEST  PROGRAM  1 


Node  Enter  Phase  2  1 
Solution  Node  3 
Nodes  Examined  3 
Maximum  List  Size  1 

Simplex  Iterations'*  9 


The  first  subprogram  requires  5  simplex  iterations. 
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Vatin  (1973).  Additional  concave  nonlinear  programs,  of  the  type 
given  in  Section  t> , 3 ,  have  been  solved  using  the  1 C0N  algorithm. 

n . 2  A  Mixed  integer  Linear  Program 

Test  program  2  is  a  mixed  integer  linear  program  obtained  from 
Haldi  (1964).  The  formulation  and  solution  of  this  test  program  are 
shown  in  Tables  10  and  ll.  Application  of  the  branch-and-bound  method 
to  test  program  2,  using  the  priority/maxmin  solution  strategy  and 
limit  tightening,  results  in  the  statistics  shown  in  Table  12. 

Computational  experience  with  mixed  integer  linear  programs  has 
included  the  solution  of  programs  from  llaldi  (1964),  Carfinkel  and 
Nemhauser  (1972),  and  Giglio  and  Wagner  (1964).  Additional  mixed 
integer  linear  programs,  of  the  type  given  in  Section  6.3,  have  been 
solved  using  the  ICpN  algorithm. 

6.3  Ail  Integer  Concave  Program 

Vest  program  3  is  an  integer  concave  program  obtained  from 
Loomis  (1973a).  The  formulation  of  this  test  program,  as  shown  in 
Tallies  13  through  17,  includes  both  a  separable  concave  objective 
function  and  integer-valued  variables.  An  alternative  (and  equivalent) 
formulation  as  a  mixed  integer  linear  program  is  obtained  by  replacing 
condition  (iv)  in  Table  13  with 

(iv)  '  x.  integer  for  1  «-  j  •  24 
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and  by  defining 


for  17  <  j  <r  24.  A  concave  nonlinear  program  is  obtained  from  test 
program  3  by  deleting  condition  (iv)  entirely.  The  solutions  to  test 
program  3,  the  equivalent  mixed  integer  linear  program,  and  the  related 
concave  nonlinear  program  are  shown  in  Table  18.  Application  of  the 
branch-and-bound  method  to  these  programs,  using  the  LIFO/maxmax 
solution  strategy  and  limit  tightening,  results  in  the  statistics 
shown  in  Table  19. 
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TABLE  10 


TEST  PROGRAM  2 

maximize  x0  +  x,  + 

3  4  5 

such  that  2x1  +  3x„  +  x_  +  2x.  +  2xc  c  18 

1  2  3  4  5 

3x  +  2x  +  2x  +  x.  +  2x_  <  15 
1  2  3  4  5 

-  6x^  +  x^  c  0 

-  7x2  +  x4  s  0 

0  s  <  1 
0  ^  x2  <  1 
0  <  s  6 

0  <  x,  <7 

4 

0  s  x5  9 

Xj  integer  for  1  <.  j  £  5 


TABLE  11 


SOLUTION  TO  TEST  PROGRAM  2 


f 

x. 


7 

0 

1 

0 

7 

0 
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TABLE  12 


BRANCH-AND-BOUND  STATISTICS  FOR  TEST  PROGRAM  2 


Node  Enter  Phase  2 


Solution  Node 


Nodes  Examined 


Maximum  List  Size 


Simplex  Iterations 


The  first  subprogram  requires  5  simplex  iterations. 
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TABLE  13  (Continued) 


(iii)  40  <  x  <  u° 


(iv)  Xj  integer  for  1  <  j  £  16 


where 


f  . 
J 


(Xj) 


( 

0  ,  if  xj  =  0 

< 

C:,  if  xi  >  0 
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CONSTRAINT  MATRIX  A  =  [a. .]  FOR 
TEST  PROGRAM  3  1J 
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TABLE  14  (Continued) 
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0224  1.1783  .63822  .7381  .6234  .40417  .15283  .29269 

8700  2.1150  .57995  1.1132  .3276  .41676  .86077  .26108 

1890  .3723  .07318  .2031  .0837  .12291  .19143  .03371 

0705  .3664  .22251  .6653  0  .34865  .35038  .14164 

0  .3969  .24297  .6081  0  .40708  .22731  .12580 


TABLE  15 


RIGHT- HAND-SIDE  VECTOR  FOR 
TEST  PROGRAM  3 


1 

3.9415 

2 

3.8398 

3 

1.09980 

4 

138.190 

5 

3.8663 

6 

0.01841 

7 

77.595 

8 

29.070 

9 

2.6440 

10 

5.0324 

11 

2.13960 

12 

7.1200 

13 

4.7010 

14 

0.03371 

15 

3.90961 

16 

1.96236 

81 


TABLE  18 


SOLUTION  TO  TEST  PROGRAM  3 


Concave 

Mixed  Integer 

Integer 

Nonlinear 

Linear 

Concave 

Program 

Program 

Program 

f*  = 

958.048 

974.3 

974.3 

X1  = 

4 

4 

4 

X2  = 

0 

0 

0 

X3  = 

2 

2 

2 

X4  = 

3 

3 

3 

X5  = 

0 

0 

0 

X6  = 

0.00445491 

0 

0 

X7  = 

1 

1 

1 

X8  = 

1.99555 

2 

2 

X9  = 

0 

0 

0 

X10  = 

0 

0 

0 

X11  = 

0 

0 

0 

X12 

0 

0 

0 

X13 

0 

0 

0 

II 

X 

11.2654 

12 

12 

X15 

4.56966 

5 

5 

X16  = 

5 

5 

5 

X17  = 

0.315789 

1 

0.315789 

X18  = 

1 

1 

1 

X19  = 

0 

0 

0 

X20  = 

0.166667 

1 

0.166667 

X21 

0 

0 

0 

X22 

0.938785 

1 

1 

X23 

0.704088 

1 

0.750000 

X24  = 

0.672099 

1 

0.709677 
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TABLE  19 


BRANCH -AND -BOUND  STATISTICS  FOR  TEST  PROGRAM  3 


Concave 

Nonlinear 

Program 

Mixed  Integer 
Linear 

Program 

Integer 

Concave 

Program 

Node  Enter  Phase  2 

1 

31 

43 

Solution  Node 

2 

73 

167 

Nodes  Examined 

5 

79 

225 

Maximum  List  Size 

1 

13 

17 

Simplex  Iterations^ 

78 

367 

1018 

The  first  subprogram  requires  68  simplex  iterations. 
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appendix  a 


input  description 


The  input  data  for  the  IC$N  branch-and-bound  algorithm  are  de¬ 
scribed  in  this  appendix.  This  data  consists  of  the  following  seven 
basic  items: 

(i)  Control  cards, 

(ii)  Constraint  matrix  and  right-hand-side  vector, 

(iii)  Lower  and  upper  limits  on  the  variables, 

(iv)  Cost  data, 

(v)  Lists  of  integer /concave  variables, 

(vi)  User  input,  and 

(vii)  Initial  feasible  basis  for  the  first  subprogram. 

Each  data  item  will  be  described  in  detail  below.  The  input  data  are 
accepted  by  the  IC0N  algorithm  in  the  sequence  indicated,  with  data 
items  (vi)  and  (vii)  being  optional  depending  upon  the  requirements 

of  a  particular  program  being  solved.  All  input  data  is  normally  read 
from  tape  unit  5.  However,  data  item  (ii)  can  be  read  from  a  separate 
tape  unit  (tape  unit  1)  if  desired  by  the  user.  Appendix  C  contains 
the  input  data  for  the  three  test  programs. 
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CONTROL  CARDS 


The  tour  control  cards  are 
specify  the  program  dimensions. 


required  input  for  each  program.  These 
the  solution  method  to  be  used,  and 


program  identification  information. 


Card  1  (Format  lb  1 5) 

The  first  ten  parameters  must  be  specified  by  the  user.  The  last 


six  parameters  need  not  be  specified  unless  a  value  other  than  the 
default  value  is  desired. 

Variable  Card  Columns  _ Description _ 


1.  N  1-5 


2.  M  6-10 


3.  I  TYPE  11-15 


Number  of  variables  (excluding  slack, 
surplus  or  other  variables  which  are 
automatically  added  to  the  program  as 
required) 

Number  of  constraints  (excluding  the 
lower  and  upper  limit  constraints  on 
the  variables) 

Program  type  (0  =  integer  concave; 

1  =  mixed  integer  linear;  2  =  concave 
nonlinear;  3  =  linear) 


A.  NSTRAT  lb-20 


5.  N0DRL1  21-25 


6.  NBVRL1  26-30 


Number  of  solution  strategies  to  be 
used  (1  =  one  strategy  to  be  used  in 
both  phases;  2  =  two  strategies,  the 
first  to  be  used  in  phase  1  and  the 
second  in  phase  2) 

Node  selection  rule  for  the  first 
solution  strategy  (0  =  priority  rule; 
l  =  LIFO  rule) 

Branching  variable  selection  rule  for 
the  first  solution  strategy  (0  =  maxmin 
rule;  1  =  maxmax  rule;  2  =  modified 
maxmax  rule;  3  =  most  noninteger  rule 
for  mixed  integer  linear  programs;  4  = 
weighted  noninteger  rule  for  mixed 
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i 


i 


Variable 

Card  Columns 

Description 

integer  linear  programs;  5  =  conven¬ 
tional  rule  for  concave  programs) 

7. 

NTITE1 

31-35 

Limit  tightening  option  for  the  first 
solution  strategy  (0  =  tighten  limits 
before  solving  a  subprogram;  1  =  leave 
the  limits  alone) 

8. 

N0DRL2 

36-40 

Node  selection  rule  for  the  second 
solution  strategy 

9. 

NBVRL2 

41-45 

Branching  variable  selection  rule  for 
the  second  solution  strategy 

10. 

NTITE2 

46-50 

Limit  tightening  option  for  the  second 
solution  strategy 

11. 

MXLIST 

51-55 

Maximum  number  of  nodes  allowed  in  the 
branch-and-bound  list  (at  most  1000; 
default  value  is  1000) 

12. 

LISTtfP 

56-60 

Branch-and-bound  list  option  (0  =  in¬ 
clude  the  basis  inverse  in  the  list; 

1  =  do  not  include  the  basis  inverse 
but  rather  use  the  basis  reinversion 
feature  to  regenerate  it) 

13. 

ITAPE 

61-65 

Input  tape  for  the  constraint  matrix 
and  right-hand-side  vector  (1  or  5; 
default  value  is  5) 

14. 

1FB 

66-70 

Initial  feasible  basLs  option  (0  =  not 
used;  1  =  used) 

15. 

MXITER 

71-75 

Maximum  number  of  pivots  allowed  for 
any  one  subprogram  (default  value  is 
1000) 

16.  MBINV 


76-80 


Number  of  pivots  between  basis  rein¬ 
versions  (0  =  basis  reinversion  fea¬ 
ture  not  used) 


The  three  parameters  on  this  card  need  not  be  specified  unless  a 


Variable 

Card  Columns 

Description 

4.  UN0T 

37-48 

Initial  best  upper  bound 

(default 

value  is  lO^OO) 

5.  PCBUB 

49-60 

Variable  best  upper  bound 

solution 

method  option  (if  PCBUB  =  0,  the 
variable  best  upper  bound  method  is 
not  to  be  used;  otherwise,  the  method 
is  to  be  used  with  PCBUB  as  the 
quantity  for  incrementing  the  best 
upper  bound  during  phase  1) 

Card  4  (Format  10A8) 

An  80  character  alphanumeric  identifier  for  the  program  is 
specified  next.  This  is  read  into  the  array 


(ALPHA(I) ,  I  =  1,10) 


under  the  format  specified 


CONSTRAINT  MATRIX  AND  RIGHT-HAND-SIDE  VECTOR 


I'he  MxN  constraint  matrix  and  the  M  component  right-hand-side 
vector  are  required  input  for  each  program.  If  parameter  ITAPE  on  the 
first  control  card  has  the  value  1,  this  information  is  read  from  tape 
unit  1;  otherwise,  it  is  assumed  that  this  information  follows  immedi¬ 
ately  after  the  control  cards  on  tape  unit  5.  For  large  programs,  the 
constraint  matrix  and  right-hand-side  vector  can  be  very  bulky.  The 
input  tape  option  is  useful  in  such  a  situation  since,  with  ITAPE  =  1, 
this  data  need  not  be  provided  as  input  in  card  form  but  can  be  read 
from  a  previously  prepared  tape. 

For  large  programs,  the  constraint  matrix  is  often  sparse,  having 
many  entries  which  are  zero.  Consequently,  the  input  associated  with 
the  constraint  matrix  can  be  greatly  reduced  if  only  the  nonzero  entries 
need  be  specified.  Also,  it  is  noted  that,  among  the  nonzero  entries, 
certain  values  recur  often  and  that  input  can  be  further  reduced  by 
establishing  a  table  of  constants  in  which  each  such  value  is  listed 
only  once. 

The  constraints  of  the  program  are  assumed  to  be  ordered  as 
follows:  less  than  or  equal,  equality,  and  greater  than  or  equal 

constraints . 
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Card  1  (Format  3 1 5 ) 


Variable 

Card  Columns 

Description 

1.  Ml 

1-5 

The  number  of  less  than  or 
straints  in  the  program 

equal  con- 

2.  M2 

6-10 

The  number  of  equality  constraints  in  the 
program 

3.  M3 

11-15 

The  number  of  greater  than 
straints  in  the  program 

or  equal  con- 

Card(s)  2 

(Format  1615) 

The  number  of  nonzero 

entries  in  each  column  of  the 

constraint 

matrix  is 

specified  next. 

This  information  is  read  into 

the  array 

(NZ(J),  J  =  1 ,N) 

under  the 

format  specified. 

Multiple  input  cards  are  needed  if  N 

exceeds  16 

,  with  subsequent 

cards  having  the  same  format. 

An  auxiliary 

parameter, 

NSUM,  is  computed  to  be  the  sum  of  the  values 

NZ(J)  for 

J  =  1,N. 

Card(s)  3  (Format  1615) 

For  each  column  of  the  constraint  matrix,  the  nonzero  entries  are 
specified  as  follows:  an  indicator  of  the  row  in  which  the  entry  occurs, 
and  a  pointer  to  the  appropriate  value  in  the  table  of  constants. 

For  the  J-th  column,  there  are  NZ(J)  nonzero  entries.  Let  IR(K) 
and  IA(K)  for  K  =  1,NZ(J)  denote  the  row  of  the  K-th  nonzero  entry  and 
the  pointer  to  the  table  of  constants.  The  elements  of  the  arrays  1R 
and  1A  alternate  on  the  input  cards  and  are  read  in  the  sequence 
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(IR(K) ,  IA(K) ,  K  =  1 ,NZ( J) ) 


under  the  torniat  specified.  Multiple  input  cards  are  needed  if  NZ(J) 
exceeds  8,  with  subsequent  cards  having  the  same  format. 

This  information  is  repeated  for  each  column  J  =  1,N. 

Card  4  (Format  15) 

The  input  for  the  table  of  constants  is  preceded  by  the  following 
parameter: 

Variable  Card  Columns  _ Description _ 

1.  NTC  1-5  Number  of  entries  in  the  table  of  con¬ 

stants 

Card(s)  5  (Format  6E12.0) 

The  table  of  constants  is  specified  next.  This  information  is 
read  into  the  array 


(TC (K) ,  K  =  l.NTC) 

under  the  format  indicated.  Multiple  input  cards  are  needed  if  NTC 
exceeds  6,  with  subsequent  cards  having  the  same  format. 

Card(s)  6  (Format  6E12.0) 

The  right-hand-side  vector  is  specified  next.  This  information  is 
read  into  the  array 

(BORIG(I),  I  =  1,M) 
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LOWER  AND  UPPER  LIMITS  ON  THE  VARIABLES 


The  lower  and  upper  limits  on  the  program  variables  are  assigned 
initial  values  of  0  and  +  *  (respectively)  by  the  program.  The  follow¬ 
ing  inputs  permit  the  assignment  of  initial  values  other  than  the 
default  values.  Cards  1  and  4  are  mandatory  inputs. 

Card  1  (Format  15) 

Variable  Card  Columns  _ Description _ 

1.  NDN  1-5  The  number  of  lower  limits  to  be  assigned 

values  other  than  the  default  value  0 

If  NDN  is  not  zero,  the  following  two  cards  are  provided  as  input. 
Card(s)  2  (Format  1615) 

A  list  of  the  variables  for  which  the  lower  limits  are  to  be 
assigned  values  other  than  the  default  value  0  is  given  next.  This 
information  is  read  into  the  array 

(NV (K) ,  K  =  1 ,NDN) 

under  the  format  indicated.  Multiple  input  cards  are  needed  if  NDN 
exceeds  16,  with  subsequent  cards  having  the  same  format. 

Card(s)  3  (Format  6E12.0) 

A  list  of  the  lower  limits  corresponding  to  the  variables  speci¬ 
fied  on  card ( s)  2  is  given  next.  This  information  is  read  into  the 
array 
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( V (K) ,  K  =  1 ,NDN) 


under  the  format  indicated.  Multiple  input  cards  are  needed  if  NUN 
exceeds  6,  with  subsequent  cards  having  the  same  format. 


Card  4  (Format  15) 


Variable  Card  Columns 


Description 


1.  NUP  1-5  The  number  of  upper  limits  to  be  assigned 

values  other  than  the  default  value  +  ®> 

If  NUP  is  not  zero,  the  following  two  cards  are  provided  as  input. 


Card(s)  5  (Format  1615) 

A  list  of  the  variables  for  which  the  upper  limits  are  to  be 
assigned  values  other  than  the  default  value  +  m  is  given  next.  This 


information  is  read  into  the  array 


(NV (K) ,  K  =  1 ,NUP) 

under  the  format  indicated.  Multiple  input  cards  are  needed  if  NUP 
exceeds  16,  with  subsequent  cards  having  the  same  format. 


Card(s)  6  (Format  6E12.0) 


A  list  of  the  limits  corresponding  to  the  variables  specified  on 


card(s)  5  is  given  next.  This  information  is  read  into  the  array 


(V  (K)  ,  K  =  1  ,NUP) 


under  the  format  indicated.  Multiple  input  cards  are  needed  if  NUP 
exceeds  6,  with  subsequent  cards  having  the  same  format. 
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COST  DATA 


The  cost  data  'objective  function  coefficients)  for  those 
variables  which  enter  linearly  into  the  objective  function  are  the  next 
inputs.  For  variables  which  enter  nonlinearly  into  the  objective 
function,  the  appropriate  cost  data  is  obtained  by  calling  the  user 
supplied  subroutine  GET0BJ. 

Card(s)  1  (Format  6E12.0) 

file  cost  data  is  read  into  the  array 

(C2(J),  J  =  1 ,N) 

under  the  format  indicated.  Multiple  input  cards  are  needed  if  N 
exceeds  6,  with  subsequent  cards  having  the  same  format. 

For  variables  J  which  enter  nonlinearly  into  the  objective 
function,  the  corresponding  value  C2(J)  should  be  set  to  zero  or  left 


LISTS  OF  INTEGER/ CONCAVE  VARIABLES 


A  list  of  the  integer  variables  and/or  a  list  of  the  concave 
variables  are  the  next  inputs.  For  an  integer  concave  program  (ITYPE  - 
0) ,  both  lists  are  required  input.  Only  the  list  of  integer  variables 
is  required  for  a  mixed  integer  linear  program  (ITYPE  =  1)  and  only  the 
list  of  concave  variables  is  required  for  a  concave  nonlinear  program 
(ITYPE  =  2).  Neither  list  is  required  for  a  linear  program  (ITYPE  =3). 

Card  1  (Format  15) 

Variable  Card  Columns  _ Description _ 

1.  NINT  1-5  Number  of  integer  variables 

Card(s)  2  (Format  1615) 

The  list  of  the  integer  variables  is  read  into  the  array 

(NV(tC),  K  =  l.NINT) 

under  the  format  indicated.  Multiple  input  cards  are  needed  if  NINT 
exceeds  16,  with  subsequent  cards  having  the  same  format. 

Card  3  (Format  15) 

Variable  Card  Columns  _ Description _ 

1.  NCC  1-5  Number  of  concave  variables 

Card(s)  4  (Format  1615) 

The  list  of  concave  variables  is  read  into  the  array 
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(NV(K),  K  =  1 ,NCC) 


under  the  format  indicated.  Multiple  input  cards  are  needed  if  NCC 
exceeds  16,  with  subsequent  cards  having  the  same  format. 
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USER  INPUT 


For  integer  concave  and  concave  programs  (ITYPE  =  0  or  2) ,  the 
user  supplied  subroutine  GET0BJ  computes  the  nonlinear  components 
appearing  in  the  objective  function.  The  user  supplied  subroutine 
READIN  accepts  any  input  which  may  be  required  to  facilitate  this 
computation.  This  user  input  immediately  follows  the  lists  of  integer/ 
concave  variables  in  the  input  stream. 


103 


INITIAL  FEASIBLE  BASIS 
FOR  THE  FIRST  SUBPROGRAM 


In  che  integer  concave  program,  the  first  subprogram  requires 
substantially  more  effort  to  solve  than  the  subsequent  subprograms. 

The  first  subprogram  may  involve  a  two  phase  linear  program  beginning 
from  an  initial  basis  which  consists  of  slack  and  artificial  variables, 
unlike  subsequent  subprograms  which  are  solved  much  more  rapidly  be¬ 
cause  computations  begin  from  a  near  optimal  basis.  For  a  large  in¬ 
teger  concave  program  involving  many  variables  and/or  constraints, 
the  first  subprogram  may  require  substantial  computer  time  for  its 
solution. 

Having  solved  an  integer  concave  program,  a  related  program  with 
similar  data  can  be  solved  more  quickly  using  the  initial  feasible 
basis  option,  which  is  signalled  by  setting  IFB  =  1  on  the  first 
control  card.  An  initial  (dual  or  primal)  feasible  basis  for  the 
first  subprogram  is  then  included  in  the  program  input.  A  basis  in¬ 
version  feature  is  used  to  commence  the  solution  of  the  first  subprogram 
from  this  basis. 

Even  on  the  first  attempt  to  solve  an  integer  concave  program, 
the  initial  feasible  basis  option  can  be  used  profitably  if  a  feasible 
solution  is  known. 

Card(s)  1  (Format  1615) 

A  list  of  the  variables  which  constitute  the  initial  feasible 
basis  is  read  into  the  array 
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(IBV(I),  I  =  1 »M) 


under  the  format  indicated.  Multiple  input  cards  are  needed  if  M 
exceeds  16,  with  subsequent  cards  having  the  same  format. 

Card  2  (Format  15) 

Variable  Card  Columns  _ Description _ 

1,  NUP  1-5  The  number  of  nonbasic  variables  initially 

at  upper  bound 

Card(s)  3  (Format  1615) 

If  NUP  is  nonzero,  the  list  of  nonbasic  variables  initially  at 
upper  bound  is  required  input.  This  list  is  read  into  the  array 

(NV (K) ,  K  =  l.NUP) 

under  the  format  indicated.  Multiple  input  cards  are  needed  if  NUP 
exceeds  16,  with  subsequent  cards  having  the  same  format. 
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— k. 


This  appendix  describes  the  three  routines  which  must  be  coded  by 
the  user  for  each  integer  concave  program  to  be  solved.  These  are: 

(i)  Program  MAIN, 

(ii)  Subroutine  READIN,  and 

(iii)  Subroutine  GET0BJ. 

Appendix  C  contains  the  actual  routines  used  in  the  solution  of  the 
three  test  programs. 

Program  MAIN  serves  three  basic  functions.  The  first  of  these  is 
the  specification  of  the  ten  tape  units  used  by  the  IC0N  algorithm: 
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areas  of  mass  storage  by  means  of  the  read  and  write  instructions 
formerly  used  for  peripheral  tape  devices. 

The  second  basic  function  served  by  the  program  MAIN  is  the  al¬ 
location  of  core  storage  to  the  two  basic  arrays  (arrays  IF  and  F) 
used  in  the  IC0N  algorithm.  These  arrays  are  in  turn  subdivided  into 
the  various  arrays  required  in  the  branch-and-bound  computation.  The 
user  must  assign  fixed  dimensions  to  arrays  IF  and  F  commensurate  with 
the  size  of  the  program  or  programs  to  be  solved.  The  parameters  NI 
and  NF  are  assigned  values  equal  to  these  dimensions.  The  IC0N  algo¬ 
rithm  determines  the  minimum  dimensions  required  to  solve  a  given 
program.  In  the  event  that  either  of  the  assigned  dimensions  fails 
to  meet  the  minimum  required  value,  a  diagnostic  will  be  printed  and 
execution  will  be  terminated. 

The  final  function  served  by  program  MAIN  is  to  transfer  control 
of  the  computation  to  the  branch-and-bound  algorithm.  This  is  accom¬ 
plished  by  calling  subroutine  IC0N,  the  master  subroutine  in  the 
algorithm,  and  by  passing  the  locations  of  arrays  IF  and  F  together 
with  parameters  NI  and  NF  to  the  subroutine. 

Subroutines  READIN  and  GET0BJ  are  required  only  for  integer  con¬ 
cave  and  concave  nonlinear  programs.  These  subroutines  together  provide 
the  mechanism  by  which  the  nonlinear  components  fj(xj)  appearing  in  the 
program  objective  function  are  computed.  Subroutine  READIN  is  called 
once,  just  before  the  branch-and-bound  algorithm  commences.  This  sub¬ 
routine  serves  to  read  in  any  input  data  which  may  be  required  in  the 
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computation  of  the  functions  fj(xj)  and  also  serves  to  perform  any 
supporting  computations  or  manipulation  of  data  which  need  be  done 
only  once.  Subroutine  GET0BJ  is  called  repeatedly  in  the  course  of 
the  branch-and-bound  algorithm.  It  serves  to  compute  the  value  fj(xj) 
for  any  particular  choices  of  j  and  xj.  Note  that  the  index  j  used  in 
subroutines  READIN  and  GET0BJ  refers  to  the  j-th  nonlinear  component 
of  the  objective  function.  Any  data  which  is  to  be  passed  from  sub¬ 
routine  READIN  to  subroutine  GET$BJ  should  be  placed  in  labeled  common 
storage. 


Ill 


The  user  subroutines  and  input  for  the  three  test  programs  are 


presented  in  this  appendix.  This  provides  an  illustration  of  the 
discussions  given  in  Appendices  A  and  B. 

The  user  supplied  subroutines  for  test  program  1  are  shown  in 
Exhibit  1.  In  program  MAIN,  lines  1-3  and  8-11  serve  to  specify  the 
ten  tape  units  required  together  with  the  amount  of  core  storage  to  be 
allocated  to  the  associated  buffer  areas.  Subroutine  BUFSHAR,  a  system 
subroutine  available  in  the  CDC  6700  computer  system,  enables  the 
assignment  of  a  single  buffer  area  to  two  or  more  tape  units.  Lines 
4-7  in  program  MAIN  allocate  storage  to  the  arrays  IF  and  F,  which  are 
located  in  blank  common  for  test  program  1.  Control  is  transferred  to 
the  branch-and-bound  algorithm  at  line  13.  Subroutines  READIN  and 
GET0BJ  are  coded  for  the  general  concave  nonlinear  program  in  which  the 
functions  fj(Xj)  are  quadratic  for  xj  0  and  are  zero  for  Xj  =  0: 


fj<xj>  = 


,  if  Xj  =  0 


Cl 


(j)  +  C2(j)  •  xj  +  C3( j)  •  xj  ,  if  Xj  *  0. 


Subroutine  READIN  accepts  as  input  the  number  of  nonlinear  components 
of  the  objective  function  (NCC)  and  the  coefficients  of  the  quadratic 
terms  (Cl(j) ,  C2(j),  and  C3(j)  for  j  =  1,NCC).  This  data  is  passed  to 
subroutine  GET0BJ  using  labeled  common  storage.  Note  that,  in  the 
computation  of  fj(Xj)  in  subroutine  GET0BJ,  the  branch-and-bound  input 
parameter  T0L2  (located  in  C0MM0N/P1/)  is  used  as  a  tolerance  to  test 
if  xj  =  0. 
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The  input  for  test  program  1  is  shown  in  Exhibit  2.  The  first 
four  cards  are  the  control  cards.  The  constraint  matrix  and  right- 
hand-side  vector  appear  on  cards  5-13.  The  lower  and  upper  limits  on 
the  variables  are  specified  on  cards  14-17.  Cost  data  for  the  variables 
which  enter  linearly  into  the  objective  function  appear  on  card  18. 

The  list  of  the  concave  variables  in  the  program  is  given  on  cards  19 
and  20.  The  last  three  cards  are  the  input  for  user  subroutine  READIN. 

The  user  supplied  subroutines  for  test  program  2  are  shown  in 
Exhibit  3.  Program  MAIN  for  test  program  2  is  in  its  simplest  form. 
Subroutines  READIN  and  GET0BJ  are  dummy  subroutines  since  these  are 
not  required  for  a  mixed  integer  linear  program.  The  input  data  for 
test  program  2  are  shown  in  Exhibit  4.  Originally  a  maximization 
problem,  test  program  2  has  been  converted  to  a  minimization  problem 
by  changing  the  sign  of  the  cost  data  appearing  on  card  19.  Note 
that,  in  the  case  of  a  concave  or  integer  concave  program,  the  con¬ 
version  from  maximization  to  minimization  would  require  a  corresponding 
change  in  sign  of  fj(xj)  computed  by  subroutine  GET0BJ. 

The  user  supplied  subroutines  and  input  for  test  program  3  are 
shown  in  Exhibits  5  and  6.  The  user  subroutines  differ  from  those  of 
test  program  1  only  in  the  dimensions  assigned  to  arrays. 
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EXHIBIT  I 


USER  SUBROUTINES  FOR  TEST  PROGRAM  1 


PROGRAM  MAIN  (INPUT , OUTPUT,  TAPES*. INPUT,  TAPE6=0U TPUT , 

1  TAPEl  .TAPE  2=5  0  0.  TAPE  3  =  20  Q3  ,TAPE4=0, 

2  TAPE7 ,T APES, I APE9=C ,TAPE13=0> 

C  AKRATi  IF  ANU  F  AkE  DIMENSIONED  dt  TmE  USER  10  SUll  HIS  PROGRAH. 
COMMON  IF  (10  71 )  ,F  (2165) 

NI-10  70 
NF=21b5 

C  COMMON  d  JFf  c.RS  FOR  TAFEs  1  ANC  4 ,  7  AND  9,  8  AND  10. 

CALL  JUFSPAR  (1,4) 

CAll  dUFSFAR  (7,9) 

CALL  dUFSHAR  (6,10) 

C  TRANSFER  CONTROL  TO  Tpl  BRANCH-ANC-BOUNO  ALGORITHM. 
call  ICCN  (IF,F,NI,NF) 
call  EXIT 
ENO 


HA  I  NO  0  0 1 
HA  I  NO  0  0  2 
MAINQ00  3 
MAIN00C4 
MAIN 0005 
MAINQQ06 
MAINQ007 
HAIN0L08 
MA1N0009 
MAINQOlo 
MAIN0011 
MAIN0C12 
HA  I  NO  0 1 3 
MAIN001 4 
M  A  I  NO  C  1  5 


SUBROUTINE  REAUIN 

C  QUADRATIC  FUNCTION  HI  IH  SETUP  COST  AT  THE  ORIGIN. 

COMMON/ IN  TUT/NCC.C1 12) ,C2  (2  > ,C3 (2  ) 

RE  AU ( 5 ,  1000  ) NCC 
MRIT£(6, 1002 )NCC 
00 1 0  0  J= 1 , NCC 

READ <5, lOOl)Cl(-) ,C2TJ) ,C3EJ) 

100  WRITE(6,10G3)J,C1  ( J ) ,C2(J),C3(J) 

RETURN 

100  0  FORMAT (  15) 

1001  FORMAT ( JE12.C) 

1002  FORMAT (42HJUSER  INPUT  FOR  8RA NCH- AND- BO  UN C  ALGORITHM/ 

1  30  PO  NUMBER  OF  CONCAVE  VARIABLES  =,15/ 

2  lHG,3X,2PCC,14X,2HCi,15X,2HC2,15X,2HC3/lX,8HVARIAdLE/ 

3  2X , 6HNUM  c£  h// ) 

1003  rCRMAT(3X,I5,3X,3 (E 15.6,2X1 ) 

ENO 


REAOQOOl 
RE  ADO  00  2 
RE  ADC  C  0  3 
RE  ADO  C  0  4 
RE  ADO  0  0  5 
RE AU0006 
REAO0C07 
RE  ADO  CO  8 
READ0009 
REAOCOlO 
RE  ADO  0 1 1 
RE  ADO  0 1 2 
RE ADQC13 
READ0C14 
RE  A  00 G 1 5 
RE AD0016 
REAG0017 


SUBROUTINE  GETOBJ  (J,X,OdJ) 

C  OUAORA  TIC  FUNCTION  KITH  SETUP  COST  AT  THE  ORIGIN. 

COMMON/P1/N, M, IT YPC,NSTRAT,H0CRL1 ,N3VRL 1 , NT  I T El , NODRL 2 , N3 VRL2 , 

1  NTITE2, MXLIST,LlSTOP,IT APE, IF3.PXITER, MOINV, IOUTPT, 

2  IT  RACE ,  PS  TART , TIME1, TOL 1 , TOl 2 ,PCBUB , AL P  FA  ( 1  0  ) 

COMMON/ INPUT/- CC.C1T2) ,C2  12  >, C3(2> 

IF (X.GT .TCL2)uJTO  ICO 

08 J=0 . 0 

RETURN 

100  0  o  J- C 1  ( J )  ♦  X«(C2(J)  ♦  X  »  C3  <  J )  ) 

RETURN 

ENO 


GETOOOOl 
GEI00002 
GE  TOO  0  0  3 
GETO3L04 
GET00005 
GET00006 
GET  00  0  07 
GE  TOO  0  0  8 
GE  TOO  0  09 
GETOOCIO 
GET OO  0 1 1 
GET00012 
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EXHIBIT  2 


INPUT  DATA  FOR  TEST  PROGRAM  1 


4 

3 

2 

1  0 

0  0 

3 

0 

0 

90 

.  0  00  1 

.0  301 

TEST  1 

PROGRAM 

1. 

CONCAVE  NONLINEAR  PROCRAM 

3 

0 

g 

3 

3 

3 

3 

1 

5 

2 

4  3 

2 

1 

5 

2 

3  3 

3 

1 

5 

2 

2  3 

5 

1 

5 

2 

1  3 

6 

6 

2 

3 

5 

150 

100 

103 

0 

4 

1 

2 

3 

4 

100 

25 

ICO 

-130 

0 

-160 

2 

2 

4 

2 

20  0  0 

-130 

-1C 

20  00 

-20  0 

-18 

EXHIBIT  3 


USER  SUBROUTINES  FOR  TEST  PROGRAM  2 


PROGRAM  MAIN  (INPUT, OUTPUT, TAFE5=INPUI, 

1  TAPE3, TAPER, TAPE7, TAPES, T 

C  ARRAYS  IF  ANO  F  ARE  DIMENSIONED  BY  THE  USER 
OIMciNilON  IF (1082) ,F (2183) 

NI=1082 
NF  =2 1  S3 

C  TRANSFER  CONTROL  TO  THE  BRANCH-ANO-BO INO  ALGORITHM. 
CALL  ICON  (1F,F,NI,NF) 

CALL  EXIT 
END 


TAPE6  =  0UTPUT,TAPE1  ,TAPE2, 
APE9.TAPE10) 

TO  SUIT  HIS  PROGRAM. 


MAIN3001 
MAIN 0002 
HAINQQO  3 
MAINOCC  A 
HA  I  NO 0  0  5 
MAINQC06 
MAIN 0007 
MAINOOOS 
MA1N9009 
MAIN 0010 


SUBROUTINE  FEADIN 

C  THIS  SUBROUTINE  IS  NOT  CAlLEO  FOR  A  MIXED  INTEGER  LINEAR  PROGRAM. 
RETURN 
ENO 


RE  AO  0 001 
P,E  ADO  C  0  2 
REAU0003 
REAUOCOR 


SUBROUTINE  GETOcJ  (J, X,06J) 

C  THIS  SUBROUTINE  la  NOT  CALLEO  FOR  A  MIXED  INTEGER  LINEAR  PROGRAM. 
RETURN 
ENO 


GE1O00G1 
GE  TOO  CO  2 
GETO3C03 
GE  TOO  009 
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EXHIBIT  4 


INPUT  DATA  FOR  TEST  PROGRAM  2 


5 

4 

1 

1 

0 

0 

0 

3 

3 

0 

90 

.OCOl 

.0001 

0 

TESI 

PROGRAM 

2. 

MIXED 

INTEGER 

LINEAR  PROGRAM 

4 

3 

0 

3 

3 

3 

3 

2 

1 

2 

2 

3 

3 

4 

1 

3 

2 

2 

4 

5 

1 

1 

2 

2 

3 

1 

1 

2 

2 

1 

4 

1 

1 

2 

2 

2 

5 

1 

2 

3 

-6 

13 

15 

0 

0 

0 

5 

1 

2 

3 

4 

5 

1 

1 

6 

7 

3 

C 

-1 

-1 

5 

1 

2 

3 

4 

5 
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EXHIBIT  5 


USER  SUBROUTINES  FOR  TEST  PROGRAM  3 


PROGRAM  MAIN  (INPUT .OUTPUT,  TAPE5 = INPUT , T APE6=0U TPLT , 

1  TAPE1,TAPE2=5C0, TAPE3=2000, TAPE4=0, 

2  TAPE7, TAPES, TAPE3=G  ,TAPE10=C) 

C  ARRAYS  IF  AND  F  ARE  DIMENSIONED  AT  TH (  USER  TO  SUIT  HIS  PROGRAM. 
COMMON  IF(l/75) ,F (4360) 

NI=1775 
NF  =4  360 

C  COMMON  BUFFERS  FOR  TAPES  1  ANC  4,  7  A  PO  9,  8  ANO  10. 

CALL  dUFSHAR  (1,4  ) 

CALL  BUFSHAR  (7,9) 

CALL  dUFSHAR  (8,101 

C  TRANSFER  CONTROL  TO  THE  BRANCH- ANO- DO  UNO  ALGORITHM. 

CALL  ICON  (IF,F,NI,NFI 

call  exit 

END 


HAIN0C01 
MAIN00Q2 
HAIN0C0  3 
MAINOOO  4 
MAIN0005 
MAIN0C06 
MAIN0007 
MAINOOOtt 
MAIN30C9 
MAINCC 10 
MAIN0Q11 
MAINJC12 
M  A  INC  0 1 3 
MAIN0C14 
MAIN001S 


SUBROUTINE  READ  IN 

C  QUADRATIC  FUNCTION  Hi f H  SETUP  COST  AT  THE  ORIGIN. 

COMMON/ input/ NCC.Cl (8) ,C2  (8 1 ,C3  (6) 

Rt AO ( 5 , 1000) NCC 
HR  I T  E  (6 , 1C  0  2 )  NCC 
DO100J=l,NC-C 

READ (5, 10011 C1(JI ,C2(JI ,C3(J) 

ICO  HRITE(6,1003IJ,C1(J),C2(J),C3(J) 

RE  TURN 

1CCC  FORMAT (15) 

1C01  FORMAT (3E12  .0) 

1C  0  2  FORMAT142H0USER  INPUT  FOR  ORA NCH- ANO-BOUNO  ALGORITHM/ 

1  30  FC  NUMBER  OF  CONCAVE  VARIABLES  =,15/ 

2  1H0, 3X.2HCC, 14X,  2HC1, 15X.2FC2, 15X , 2HC3/1X , 8H V AR I Ad LC/ 

3  2X ,6  FNUMEER// ) 

1G0  3  FORMAT (3X,IS,3X,3 (£15.6,2X1  ) 

END 


RE  ADO  0 0 1 
RE  ADO  0  0  2 
RE  ADO  C  0 3 
RE  ADO  C  0  4 
RE  ADO  0  05 
REA03C  06 
READG007 
RE ADO  0  3  8 
RE  ADO  0  0  9 
RE  ADO  C 1 0 
RE  ADO  C 1 1 
REA03C12 
RE ADO  013 
REAOOC14 
RE  ADO  0 1 5 
RE  ADO  C 16 
REA00017 


SUBROUTINE  GETOdJ  (J.X.OBJ) 

C  QUADRATIC  FUNCTION  HITH  SETUP  COST  AT  THE  ORIGIN. 

COMMON/ Pl/N, M,ITY  NaTRAT.NO CRL1  .NBVRL 1 , NT  IT  El , NODRL 2 , NB VRL2 , 

1  NTITE2,MXLIST, LIS  TOP, IT  APE ,IFd, FXITER ,Md I NV , I CU I P T , 

2  ITRACE,MSTAR( , T IME 1 , 1  CL  1 , T 0L2 , PCBU8 ,AL PHA ( 1 0 ) 

COMMON/ INFUT/NCC,Cl (8) ,C2  (8) ,CJ(8  ) 

IF (X.GT.T0L2TG0T0  .00 

Od  J=  0 . 0 

RETURN 

100  03 J=C1 ( J)  ♦  X* (C2( J>  ♦  X»C3(JTI 
RETURN 
ENO 


GETOOOOl 
GE TOO  0  0  2 
GET00003 
GET03C04 
GET00005 
GET00006 
GET00007 
GE  TOO  C  0 8 
GE  TOO  0  09 
GE  T  OO  0 10 
GETOO  Oil 
GE  TOO  01 2 
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EX  HI  151 T  6 


INPUT  DATA  FOR  TEST  PROGRAM  3 


24  31  3  1  1  1  0 

1  0  0 

90  . C  CO  1  .0001  0  25 

JtSI  PRO  UK  AM  3.  INTEGER  CONCAVE  PROGRAM 
1  1  29 


5 

6 

6 

6 

9 

20 

2C 

3 

17 

14 

18 

14 

19 

19 

13 

11 

1 

1 

1 

1 

1 

1 

1 

1 

5 

19 

11 

83 

15 

120 

16 

132 

24 

160 

5 

20 

13 

7 1 

11 

84 

15 

121 

19 

159 

24 

160 

1C 

71 

14 

11C 

15 

122 

16 

133 

19 

159 

24 

160 

1 

159 

5 

21 

6 

31 

7 

42 

8 

52 

10 

72 

15 

123 

25 

160 

1 

159 

5 

22 

6 

32 

7 

42 

8 

53 

10 

73 

15 

124 

16 

134 

25 

160 

2 

159 

3 

1 

4 

11 

5 

23 

6 

33 

7 

44 

8 

54 

9 

62 

10 

74 

11 

85 

12 

94 

13 

10  2 

14 

111 

15 

125 

16 

135 

17 

144 

18 

151 

20 

160 

23 

159 

27 

160 

2 

162 

3 

2 

4 

12 

5 

24 

6 

34 

7 

4  5 

8 

55 

9 

63 

10 

75 

11 

86 

12 

95 

13 

1C  J 

14 

112 

15 

126 

16 

136 

17 

145 

18 

152 

20 

159 

23 

159 

27 

160 

2 

159 

23 

159 

27 

160 

3 

3 

4 

13 

5 

25 

6 

35 

7 

46 

8 

56 

9 

64 

10 

76 

11 

87 

12 

96 

15 

1 27 

18 

153 

21 

159 

22 

16  0 

23 

159 

26 

16C 

27 

160 

3 

4 

4 

14 

5 

26 

6 

36 

7 

47 

10 

77 

11 

88 

14 

113 

16 

137 

21 

16C 

22 

161 

23 

155 

26 

160 

27 

16  0 

3 

5 

4 

15 

5 

27 

6 

37 

7 

48 

8 

57 

9 

65 

10 

76 

11 

89 

13 

104 

14 

114 

15 

1 2  ( 

16 

138 

21 

159 

22 

16C 

23 

159 

26 

1 6  J 

27 

16, 

3 

6 

5 

28 

7 

49 

8 

58 

9 

66 

11 

90 

12 

97 

13 

105 

14 

1  15 

15 

129 

16 

139 

17 

14  E 

18 

154 

31 

16  0 

3 

7 

4 

lb 

5 

29 

6 

38 

7 

50 

8 

59 

9 

67 

10 

79 

11 

91 

12 

98 

13 

1C  6 

14 

11  t 

15 

130 

16 

14  0 

17 

14  7 

18 

155 

28 

160 

30 

160 

31 

160 

3 

a 

4 

17 

5 

30 

6 

39 

7 

51 

8 

60 

9 

68 

10 

80 

11 

92 

12 

99 

13 

107 

14 

11  7 

15 

131 

16 

141 

17 

148 

18 

156 

29 

160 

30 

160 

31 

160 

3 

9 

4 

18 

6 

4  C 

9 

65 

10 

81 

11 

93 

12 

100 

13 

108 

14 

1 18 

16 

142 

17 

149 

18 

157 

31 

160 

3 

13 

6 

41 

8 

61 

10 

82 

12 

101 

13 

109 

14 

119 

16 

143 

17 

15J 

18 

158 

31 

160 

24  163 

26  164 

26  165 


27 

166 

28 

161 

29 

167 

30 

168 

31 

169 

169 

-.0644 

.9258 

.1154 

1. 02  78 

.2955 

.0  381 

.  1612 

.0154 

.7411 

. 00741 

.00400 

.11420 

.3922 

.6738 

.0886 

.0461 

-.3344 

1.0550 

.9476 

.5430 

.0502 

06441 

.  CO  754 

.  38303 
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EXHIBIT  6  (Continued) 


.09924 

.  15659 

.13567 

.01190 

.14200 

.03059 

49.664 

31.699 

11.100 

36.  95  9 

21. 934 

5  •  74  4 

16. 694 

9.329 

2.932 

.464 

2.  10  0 

.2719 

.2965 

.  0927 

1.1107 

.  20  8  3 

.2214 

.9  35  1 

.C  733 

.7313 

.2530 

. 39174 

.32166 

. 06931 

•  45466 

. 27466 

.28256 

.02106 

.3n«« 

.07237 

. 03359 

-  .  251 

26.756 

12.250 

6.  16  3 

4.  69  7 

2  3.  326 

6.365 

3.830 

.07  3 

.  526 

3.  789 

1.591 

.400 

11.975 

5.145 

20.  692 

1.  90  7 

2.  133 

.202 

.  5eo 

1.495 

.0515 

.0  225 

.1466 

.  7422 

.  0682 

1. 2945 

.2  94  7 

.0  224 

.5700 

.1990 

.  07  06 

.  0379 

.471“ 

.5  904 

1.1793 

2.1160 

.  3723 

.  3664 

.3969 

.  1=  941 

.10379 

.21799 

.63922 

.57995 

.07316 

.22251 

. 24297 

.  0742 

-2  .6200 

2.4223 

.965  2 

•  5  351 

.7  351 

1.1132 

.  2031 

.6653 

.6oe  i 

.1  371 

.0  93  3 

.1395 

.2622 

.  2643 

-1  .0  364 

2.05C1 

.6  9*  3 

.  7933 

.6234 

.  3276 

.  0  9  37 

.01521 

.01446 

.10047 

- .71932 

.71301 

•  45 1 1 6 

. 15h37 

.40  41  7 

•  4  16  7  6 

. 12291 

. 34665 

.4070= 

-.16689 

.26709 

.15253 

.86077 

.  19143 

.3503? 

.  22  7  3  1 

.  0060  1 

.  3063  7 

.39259 

. 29269 

.26103 

.03371 

.14164 

.12580 

1 

-1 

4 

-2 

19 

3 

9 

1  3 

12 

16 

31 

3 

0 

3.9415 

3.9399 

1. 0C9?  0 

135.  190 

3 . 9  66  3 

9  .  0  1 .9  4  1 

77.595 

29.070 

2.6440 

5.0324 

2.  13960 

7  .  1 2  C  0 

4.7010 

0.  03371 

3.90961 

1.96236 

2 

0 

C 

0 

3 

0 

0 

0 

0 

0 

0 

0 

1 

2 

3 

4  5 

6 

7 

9 

9  10 

11  12 

13 

14 

17 

1  5 

19 

20  21 

22 

23 

24 

11 

4 

4 

3 

3 

2 

3 

4 

4 

2 

3 

3 

4 

12 

7 

5 

1 

1 

1 

1 

1 

1 

1 

1 

22.  9 

33.2 

12.5 

11.9 

14.  9 

4  1.  0 

260.  3 

82  .  0 

101.4 

167. 1 

139.9 

54.  a 

90.6 

15.9 

10.  2 

7.  4 

0 

0 

0 

0 

0 

0 

0 

0 

16 

1 

2 

3 

4  5 

6 

7 

8 

9  10 

11  1? 

13 

14 

8 

17 

19 

19 

20  21 

22 

23 

24 

S 

30.  2 

0 

0 

10.9 

0 

3 

83.3 

0 

0 

4.  2 

3 

0 

6  2.  9 

0 

0 

11.5 

0 

0 

5  7.  6 

0 

0 

4.  2 

0 

0 
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